Roadmap
We mainly use GitHub Project to organize roadmap items. Each GitHub project represents a specific area that TrinityLake would like to explore:
Area of Development | Description |
---|---|
Tree Improvements | Improve the TrinityLake tree related algorithm and implementation |
Storage Improvements | Improve storage implementations and add more storage integrations |
View | Add view related objects to the format, like logical view, materialized view, etc. |
ML & AI Collaboration | Add features such as affinity table and affinity view to faciliate cross-team ML & AI collaboration in a lakehouse |
Access Control | Add access control related objects to the format like policy and principal, and integrate with policy language like Cedar Policy |
Index | Add index related objects to the format, such as clustering index, data sketches, vector index, etc. |
Lock Mechanism | Explore locking mechanism improvements, with features like global lock, table lock, etc. |
Lakehouse Procedures | Add various procedures for lakehouse-wide operations such as expiring old versions, export a version, etc. |
Streaming and Upsert | Explore how streaming and upsert behaves in TrinityLake's transaction mechanism |
Catalog Integration | Improve integration with catalog standards, such as the Iceberg REST Catalog standard, Hive Metastore standard, etc. |
Spark Integration | Improve integration with Apache Spark engine |
Java SDK | Develop the Java SDK for the format, used to hold items in Java SDK that are not categorized by other areas yet |
Python & Rust SDK | Develop the Python & Rust SDK for the format, used to hold items in Python & Rust SDK that are not categorized by other areas yet |