EmbeddingBridge v0.1.0-alpha2

Release v0.1.0-alpha2: S3 Remote Integration

This is the second pre-release of EmbeddingBridge, focusing on remote storage capabilities with S3 integration.

Features

• S3 Remote Storage Support

  • Push embeddings to S3 buckets with eb remote push
  • Store embeddings efficiently with Parquet file format support
  • Configure remotes with simple commands

• Set Management System

  • Create named sets of embeddings (eb set create)
  • Switch between sets (eb set switch)
  • List available sets (eb set list)
  • Compare differences between sets (eb set diff)

• Performance Improvements

  • Optimized storage format for faster recall
  • Reduced memory footprint for large embedding collections

Installation

1. Extract the archive:

   tar xzf embedding_bridge-v0.1.0-alpha2.tar.gz

2. Run the wrapper script:

   cd embedding_bridge-v0.1.0-alpha2
   ./run_embedding_bridge.sh

Remote Storage Commands

• eb remote add <name> s3://<bucket-name> - Add an S3 remote
• eb remote list - List configured remotes
• eb remote push <name> - Push current set to remote

Known Limitations

• eb remote pull is not yet functional in this release
• S3 integration requires AWS credentials in your environment
• eb rm command has limited testing and may have edge case issues
• eb gc (garbage collection) should be used with caution
• Windows support is experimental

Bug Reports

Please report any issues on our GitHub issue tracker.