Nebula API v0.0.13: Image & Transaction Message

Overview
This release includes significant improvements to the Nebula agent's architecture, entity memory management, error handling, and documentation search capabilities. Key updates focus on simplifying blockchain entity handling, improving transaction management, supporting more content types in chat, and enhancing error messaging for a better user experience.
Features
- New Content Support in Chat
- Add support for image and transaction content types in chat messages
{
"messages": [
{
"role": "user",
"content": [
{ "type": "image", "image_url": "ipfs://Qmefr67P2qZS5BS9KBbZVgVXAYCdeezkN4je4tnd6xib4c" },
{ "type": "text", "text": "Please describe the image" }
]
}],
"stream": "true",
}
- Enable transaction hash messages for blockchain status checks
{
"messages": [
{
"role": "user",
"content": [
{ "type": "transaction", "transaction_hash": "0x112c7d127dbd1fef1006aa6211462a2635b504fc42f71aad0cae4b1e7ddba32a", "chain_id": 1 }
]
}],
"stream": "true",
}
- Enhanced Entity Management
- Simplify loading entities by type with a cleaner implementation
- Improve entity memory formatting for better readability
- Reduce database operations for improved performance
- Add user wallet as parsed entity for better context
- Documentation and Search Improvements
- Implement new LLMs documentation search with better context retrieval
- Add URL to web search results for better source attribution
- Format blockchain entities as links in responses
- Improved Error Handling
- Better error messaging for deployment and payment issues
- Add instructions to help users correct chain context issues
- Support graceful error handling in streaming responses
API Changes
- New agent action types for better request handling
- Support for image and transaction inputs in chat messages
- More structured error responses with helpful suggestions
- Revised agent action structure to use more specific types
- Updated event streaming format for better client compatibility
Bug Fixes
- Fix undefined behavior when no routes found in Universal Bridge
- Handle payment required errors from storage service
- Fix wallet balance formatting and improve entity display
- Ensure price and token supply data is displayed correctly
Ready to try out all these new features? Give it a spin at https://nebula.thirdweb.com!