Source Code Directory Structure
Linkis hierarchical directory structure explanation, if you want to detail Linkis, please check Linkis related architecture design documents
1. ├─assembly
2. ├─bin
3. ├─conf
4. ├─core //Core abstraction, which contains all common modules
5. │ ├─cloudModule //Modules that must be introduced by microservices, embedded Jetty + WebSocket + SpringBoot + Jersey
6. │ ├─cloudMybatis //Mybatis module of SpringCloud
7. │ ├─cloudProtocol //General protocol, such as RPC communication between Entrance and Engine
8. │ ├─cloudRPC //RPC module, complex two-way communication based on Feign implementation
9. │ ├─common //Common module, built-in many common tools
10. │ ├─httpclient //Java SDK top-level interface
11. │ └─scheduler //General scheduling module
12. ├─db //Database information
13. ├─docs //All documents
14. ├─eurekaServer //Eureka module
15. ├─extensions //plugin
16. │ └─spark-excel //spark supports excel to DF/DF to excel plug-in
17. ├─gateway //Gateway module
18. │ ├─core //Gateway core implementation, including authentication/analysis/routing of front-end interfaces
19. │ ├─gateway-httpclient-support //gateway support for Java SDK
20. │ ├─gateway-ujes-support //Analysis and routing support for UJES interface
21. │ └─springcloudgateway //Introduce spring cloud gateway, front-end requests are intercepted from here
22. ├─publicService //public service
23. │ ├─application //application module
24. │ ├─bin
25. │ ├─conf
26. │ ├─configuration //Parameter module, get the engine parameters from here
27. │ ├─database //Provide Hive metadata query service
28. │ ├─query //Provide Job Manager and Job History
29. │ ├─udf //UDF module
30. │ ├─variable //User-defined variable module
31. │ └─workspace //Workspace module, manage user scripts
32. ├─resourceManager //Resource management service
33. │ ├─resourcemanagerclient //resource management client
34. │ ├─resourcemanagercommon //Common module
35. │ └─resourcemanagerserver //Resource management server
36. ├─storage //Unified storage service
37. │ ├─pesIO //Remote storage service
38. │ │ ├─io-engine //The engine side of remote storage, which actually accesses the bottom storage side
39. │ │ ├─io-enginemanager //engineManger for remote storage
40. │ │ └─io-entrance //Request entry for remote storage
41. │ └─storage //Unified external interface for unified storage
42. └─ujes //Unified operation execution service
43. │ ├─client //Java SDK, users can directly access Linkis through Client
44. │ ├─definedEngines //Implemented engines
45. │ │ ├─hive //Hive engine
46. │ │ │ ├─engine //The engine execution end of the actual docking with the underlying Hive
47. │ │ │ ├─enginemanager
48. │ │ │ └─entrance
49. │ │ ├─pipeline //Import and export engine for mutual conduction between storage systems
50. │ │ │ ├─engine
51. │ │ │ ├─enginemanager
52. │ │ │ └─entrance
53. │ │ ├─python //stand-alone Python engine
54. │ │ │ ├─engine //The engine execution end that actually docks with the underlying Python
55. │ │ │ ├─enginemanager
56. │ │ │ └─entrance
57. │ │ ├─spark //spark engine
58. │ │ │ ├─engine //The actual connection to the engine execution end of the underlying Spark
59. │ │ │ ├─enginemanager
60. │ │ │ └─entrance
61. │ │ └─tispark //TiSpark engine, actually docking with TiSpark engine
62. │ ├─engine //General low-level engine module
63. │ ├─enginemanager //General low-level enginemanager module
64. │ ├─entrance //General low-level entrance module
65. │ └─entranceclient //Simplified version of entrance
