Welcome to the Deepset Tech Task repository.
In this repository, you'll find diagrams and descriptions of three proposed architectures:
- AWS-based Architecture: Leverages AWS services for processing and storage.
- Open Source On-Premises Architecture: Utilizes open-source technologies for a self-hosted solution.
- Multi-Cloud Architecture (Chosen): Combines services from AWS, Azure, and GCP for a resilient and scalable system.
The multi-cloud approach has been selected for its redundancy, scalability, and vendor diversification benefits.
For detailed architecture diagrams and descriptions, please refer to the architecture directory.
The document_service/ folder contains the code for the Upload API, structured to meet the needs of a scalable multi-cloud environment. The API is built with FastAPI and is designed to be simple, robust, and production-ready.
A pull request has been opened, which contains comments and discussions around best practices.
To view the code review, please visit the Pull Request link.
"The best way to predict the future is to invent it." - Alan Kay