Skip to main content
Keywords AI provides LLM observability service: keeping track of all the inputs to and outputs of LLM inferences, along with any additional metrics that are calculated during the inference, such as token usage, generation time etc.
Architecture and Data Flow Overview
Cloud Infrastructure
Amazon Web Services (AWS) as the primary cloud service provider
Application hosted on Amazon Elastic Container Service (ECS)
Redis for event queue management
PostgreSQL for persistent data storage
Data Flow
Client requests are sent to our API server hosted on AWS ECS
During LLM inference operations, events are generated and pushed to Redis queue
Celery workers consume these events from Redis
Data is batch inserted into PostgreSQL database
Security and Encryption Standards
All API communications secured via TLS 1.2+ (HTTPS)
Authentication credentials and API keys are hashed using SHA-256 (SHA-2 family) before storage
Data at rest is encrypted using AWS-managed encryption (AES-256)
Inter-service communication within AWS infrastructure is secured through AWS security groups
Security Operations
Regular internal security audits (monthly)
Weekly security testing of applications
Continuous monitoring via AWS CloudWatch
Regular code reviews (weekly)
Vulnerability scanning and penetration testing planned for next security roadmap phase
Access Controls
Multi-factor authentication (MFA) required
Role-based access control (RBAC) with least privilege
Just-in-time (JIT) access for administrative functions
Regular access reviews and deprovisioning
Incident Response
Dedicated incident response team with defined roles
Customer notification within 24 hours of any security incident
Detailed incident reports and remediation plans
Post-incident reviews and continuous improvement
Business Continuity
Recovery Time Objective (RTO) : 4 hours
Recovery Point Objective (RPO) : 1 hour
Automated daily backups with cross-region replication
Regular disaster recovery testing
Compliance & Certifications
SOC 2 Type II - Security, Availability, Confidentiality (Certified)
HIPAA - Healthcare data protection compliance
GDPR - European data protection compliance
AWS and GCP security frameworks utilized
Security Reports
Detailed security architecture documentation, penetration test reports, and compliance certificates are available to enterprise customers under NDA.
Contact : security@keywordsai.co