Insight indexer major version upgrade

Insight open source indexer has received it's first major version upgrade in beta to 1.0.2-beta and brings with it more scalable reorg handling, better reliability and more performance.

New Features

• Token Balances API endpoint - The indexer API now has a new `/balances/:owner/:type` endpoint to retrieve token balances by type (ERC20, ERC721, ERC1155) for a specified address. Added features include aggregation support, customizable responses, and options for pagination and filtering.
• Materialized views for token balances - Created materialized views to keep track of token balances as logs are being inserted.
• Chain based table configuration for Clickhouse - when using Clickhouse as a data store, you can now configure table names and default columns.
• Field selection for storage connectors - Specific fields can be fetched via storage connectors to not query everything and improve performance.

Reliability and Performance

• Improved reorg handling with Clickhouse data store - Migrated database tables to use `VersionedCollapsingMergeTree` for better data accuracy and scale when indexing multiple chains.
  NB! This is a breaking change!
• Added serialization for API responses with specific column selection to better control the data returned. Also replaced array-based topics in logs with fixed columns for more reliable data handling.
• Enhanced committing integrity - added safeguards to track the last committed block, preventing data inconsistencies and duplicate insertion.
• Graceful shutdown - Implemented context cancellation for all orchestrator components to support graceful shutdown, improving application reliability during deployment disruptions.
• GetTraces Consistency - Updated trace fetching logic to conform to API standards and enabling consistent pagination and filtering across the codebase

This update introduces substantial improvements in API functionality and performance, database consistency, and overall reliability. These changes facilitate better integration, data retrieval, and system robustness, especially in cloud-deployed environments.

Learn more about Insight and how to use it.
Insight is open source.