0.3.0

What's Changed

• Feature/redbox 146 make file subapp by @rachaelcodes in #221
• Bugfix/ruff not checking code by @gecBurton in #222
• Fix browser console errors by @KevinEtchells in #227
• feature/REDBOX-155-remove-streamlit-from-main-redbox-repo by @gecBurton in #226
• bugfix/implicit single connection by @gecBurton in #224
• add: infrastructure folder by @ghannay10 in #196
• added a redis insatance by @gecBurton in #229
• Feature/redbox 106 add vanilla chat by @rachaelcodes in #234
• feature/use html as example file by @gecBurton in #238
• Code reference documentation by @lmwilkigov in #235
• Feature/help pages by @KevinEtchells in #233
• added model to docker build by @lmwilkigov in #240
• Dockerising mlflow by @tayyib-saddique in #181
• Feature/health endpoints for workers by @gecBurton in #243
• feature/rationalise-file-endpoint-post by @gecBurton in #242
• Build file-status update JavaScript by @KevinEtchells in #247
• feature/core api deployment by @gecBurton in #230
• bugfix/corrected-redis-sg by @gecBurton in #249
• Formatting fix by @brunns in #252
• bugfix/ignore-faststream-upgrade by @gecBurton in #251
• Feature/deploy embedder ingester by @gecBurton in #254
• Bump the minor-patch group across 1 directory with 5 updates by @dependabot in #260
• feature/deploy-OPENAI-API-KEY by @gecBurton in #261
• feature/switched to having one sg per ecs service by @gecBurton in #263
• add: waf by @ghannay10 in #266
• Feature/rds by @252afh in #265
• add: cognito by @ghannay10 in #271
• bugfix/extend s3 access to ingester and embedder by @gecBurton in #273
• Fixed chunking so index is set correctly by @wpfl-dbt in #276
• Add a basic sessions page by @KevinEtchells in #275
• Build auth templates by @KevinEtchells in #280
• feature/REDBOX-105-add-RAG-chat-only by @gecBurton in #274
• feature/REDBOX-138-tighten-the-definition-of-metadata by @gecBurton in #262
• feature/integration test extended to cover RAG by @gecBurton in #279
• ruff format by @lmwilkigov in #282
• Feature/redbox 169 merge embedder and ingester into one service by @gecBurton in #268
• Add file upload endpoint for testing by @lmwilkigov in #284
• removed unused code by @gecBurton in #286
• Added models and migrations based on schema diagram by @252afh in #237
• Log cleanup and clarification by @lmwilkigov in #290
• added realistic tests data by @gecBurton in #293
• Bugfix/fix migration being arranged incorrectly by @252afh in #297
• Added django_magic_link package and email settings by @252afh in #281
• bugfix/made settings optional by @gecBurton in #299
• Feature/redbox 200 move sources to a separate field for chat endpoint responses by @gecBurton in #298
• Feature/deploy django ecs by @gecBurton in #292
• Feature/chat page functionality by @KevinEtchells in #295
• feature/remove-embeedding-endpoint by @gecBurton in #300
• feature/REDBOX-170-add-jwt-to-core-api by @gecBurton in #301
• Adding AWS_REGION as an empty parameter in .env.example to ensure new… by @andy-symonds in #303
• Fix for new core-api /chat/rag/ schema. by @brunns in #304
• Add client-side streaming to sessions page by @KevinEtchells in #306
• Feature/redbox 171 add user filtering to core api by @gecBurton in #309
• bugfix/restore-image-tag by @gecBurton in #315
• bugfix/restored model download by @gecBurton in #316
• Bump the minor-patch group across 1 directory with 16 updates by @dependabot in #319
• feature/REDBOX-171-add-user-filtering-to-core-api-part-2 by @gecBurton in #321
• Remove old frontend prototypes by @KevinEtchells in #322
• Django layer of chat streaming by @brunns in #317
• Start to introduce additional linting rules. by @brunns in #323
• Bump the minor-patch group across 1 directory with 8 updates by @dependabot in #332
• mlflow - connecting endpoints to tracking server by @tayyib-saddique in #277
• Make logging show up from Django app running in container. by @brunns in #335
• feature/deploy-django-to-internet by @gecBurton in #328
• Feature/add document management using filefield by @252afh in #320
• Feature/django-fixes by @gecBurton in #341
• Bump pydantic from 1.10.15 to 2.7.1 by @dependabot in #340
• Bump gunicorn from 20.1.0 to 22.0.0 by @dependabot in #339
• Bump gunicorn from 20.1.0 to 22.0.0 in /mlflow in the pip group across 1 directory by @dependabot in #336
• Feature/response feedback by @KevinEtchells in #327
• Feature/homepage update by @KevinEtchells in #333
• now using empty strings rather than null by @gecBurton in #344
• Spike/redbox 204 rag evaluation by @andy-symonds in #330
• Downgraded torch to 2.2.2 by @wpfl-dbt in #345
• Updates poetry lockfile after torch downgrade by @wpfl-dbt in #351
• Fix button alignment on Documents page by @KevinEtchells in #354
• feature/refactored chunking code by @gecBurton in #324
• Fix new session for every message bug by @brunns in #356
• feature/test-sign-in by @gecBurton in #343
• Added API error codes and implemented 404 on file endpoints by @wpfl-dbt in #350
• Management command for E2E tests by @brunns in #346
• Disable chunk clustering default by @lmwilkigov in #355
• Added list files endpoint by @wpfl-dbt in #360
• Bugfix/fix trailing slashes by removing whitenoise by @252afh in #359
• Feature/markdown to html by @KevinEtchells in #337
• Add COMPRESSION_ENABLED checks by @KevinEtchells in #363
• Notebook for generating CoreAPI token by @lmwilkigov in #364
• service discovery added by @gecBurton in #349
• Redirect to documents page on sucessful file upload by @KevinEtchells in #365
• bugfix/REDBOX-239-error-on-sign-in-if-already-signed-in by @gecBurton in #367
• Add condition to use small instance type for non prod env. by @dk-singh in #369
• Bugfix/sort out urls by @252afh in #368
• Added link to feedback survey by @Samuel-Hoskin in #334
• Add notification banner and backlinks to document pages by @KevinEtchells in #370
• Added contact email for support pages by @252afh in #371
• change signature by @gecBurton in #372
• Add table support for markdown to HTML conversion by @KevinEtchells in #375
• REDBOX 225 - display link to sources by @brunns in #361
• Bugfix/django tests pass locally by @gecBurton in #358
• feature/REDBOX-252-failure-to-embed-doc-leads-to-a-poor-error-message by @gecBurton in #374
• bugfix/remove-schema-from-host by @gecBurton in #378
• Remove last traces of testserver by @brunns in #382
• feature/move-deployment-instructions by @gecBurton in #383
• Introduce linting rules tranche 2 by @brunns in #380
• Handle duplicate file names by @rachaelcodes in #377
• Bump the minor-patch group across 1 directory with 9 updates by @dependabot in #384
• Feature/document status check by @252afh in #376
• Feature/daphne-webserver by @gecBurton in #385
• Use document unique name for minio download link by @252afh in #388
• Revert "Use document unique name for minio download link" by @gecBurton in #390
• Change h1 for magic link page by @KevinEtchells in #389
• commenting out mlflow in docker-compose.yml file by @tayyib-saddique in #392
• gracefully handle a lack of file by @rachaelcodes in #391
• Style sources for SSR generated responses by @KevinEtchells in #387
• Updated content on homepage by @Samuel-Hoskin in #394
• Revert "Feature/daphne-webserver" by @gecBurton in #396
• bugfix/remove-unused-postgres-password by @gecBurton in #401
• bugfix/concat-strs by @gecBurton in #402
• feature/admit-co-users by @gecBurton in #395
• Bugfix/document unique name locally by @252afh in #403
• Pull in change from main branch by @andy-symonds in #407
• feature/fast-embeddings by @gecBurton in #405
• Update doc status colour when complete by @KevinEtchells in #413
• Remove download button by @KevinEtchells in #415
• Feature/design system by @KevinEtchells in #352
• bugfix/move-from-pubsub-to-fifo-arch by @gecBurton in #414
• call core api delete from django delete by @rachaelcodes in #406
• feature/REDBOX-260-order-document-view by @gecBurton in #417
• Document how to save and load dumps from the vector store by @wpfl-dbt in #409
• Adding MLflow experiments by @tayyib-saddique in #393
• feature/omit-empty-sources by @gecBurton in #386
• bugfix/REDBOX-261-correctly-order-recent-sessions by @gecBurton in #418
• Improve UX for non-streamed responses by @KevinEtchells in #423
• Add lower jinja2 pipe to check for document status on documents.html by @252afh in #424
• Feature/redbox 234 Add file expiry date by @rachaelcodes in #425
• bugfix/remove-sources-part-2 by @gecBurton in #430
• Change favicon to i.AI by @KevinEtchells in #427
• Rename Sessions to Chats by @KevinEtchells in #426
• Add Plausible Code by @Samuel-Hoskin in #428
• Ensure feedback prompts are displayed as coming from Redbox (not User) by @KevinEtchells in #434
• feature/REDBOX-224-mechanism-to-manage-accounts by @gecBurton in #432
• Feature/streaming by @gecBurton in #314
• Order chat by date by @252afh in #436
• Restore feedback link by @KevinEtchells in #440
• feature/restore-whitenoise by @gecBurton in #442
• Feature/introduce linting rules 3 by @brunns in #441
• Feature/homepage by @Samuel-Hoskin in #412
• Update file expiry with RAG chat by @rachaelcodes in #435
• Readds sourcing to bring prompt performance back to where it was by @wpfl-dbt in #445
• Add Axe/Playwright tests by @KevinEtchells in #165
• Build fix. by @brunns in #449
• A working launch.json for Django in VSCode by @wpfl-dbt in #446
• Adds parameter for security classification by @wpfl-dbt in #451
• Introduce linting rules tranche 4 by @brunns in #447
• feature/daphene by @gecBurton in #457
• Sorted documentsby created_at and added date field to documents page by @252afh in #429
• e2e and a11y tests by @brunns in #453
• Bugfix/broken documents page test by @KevinEtchells in #459
• Feature/redbox 234 keep deleted file django reference by @rachaelcodes in #448
• Add accessibility tests for info pages by @KevinEtchells in #462
• Fix many type errors by @brunns in #464
• Expt/prompt engineering by @andy-symonds in #468
• Redirect users from sign in link to the documents page by @rachaelcodes in #470
• Update homepage and sign-in content by @KevinEtchells in #471
• Add mlflow evaluation notebook [first draft] by @esoutter in #478
• Update docs page to match latest design by @KevinEtchells in #475
• feature/separate-index-per-env by @gecBurton in #482
• bugfix/get-openai-working-again by @gecBurton in #487
• Removed deleted files from documents list by @252afh in #486
• Added email template link to negative chat feedback by @252afh in #479
• Removed usage of LLM env variable in core-api chat.py and edited log … by @252afh in #488
• Feature/redbox 297 streaming redbox prompts by @gecBurton in #485
• Introduce linting rules tranche 5 by @brunns in #483
• Adds a RAG function so you don't need the endpoint by @wpfl-dbt in #492
• Feature/rag evaluation framework by @andy-symonds in #454
• Send message on enter key press by @KevinEtchells in #495
• Bugfix/filter by exact UUID by @gecBurton in #497
• bugfix/csp-for-websockets by @gecBurton in #496
• Add tests for feedback buttons by @KevinEtchells in #498
• feature/streaming-working-on-ecs by @gecBurton in #499
• Utilised autoscaling policy setup in ecs module by @252afh in #494
• Build delete-doc E2E test by @KevinEtchells in #503
• added video to README by @gecBurton in #505
• Removed all references to languages other than British English by @wpfl-dbt in #506
• fix prod deployment by @gecBurton in #508
• Added make command that will auto-deploy-to-dev by default, or any en… by @252afh in #507
• Remove alpine.js by @KevinEtchells in #512
• Run e2e in cd pipeline by @brunns in #491
• Redraft the evaluation README by @wpfl-dbt in #510
• Parameterises s3 client for worker and chunker by @wpfl-dbt in #515
• Enable and fix final linting rules. by @brunns in #517
• Delete expired files with management command by @rachaelcodes in #518
• Create default trusted-types policy by @KevinEtchells in #521
• Expt/can eval spot regression by @andy-symonds in #519
• Add health checks by @brunns in #524
• Formatting by @252afh in #527
• Use minio to get file url in integration by @brunns in #528
• Run static checks on django_app changes. by @brunns in #529
• delete expired chats with management command by @rachaelcodes in #523
• Don't show "this is not a live service" banner in prod. by @brunns in #530
• bugfix/gpt4 by @gecBurton in #531
• Updated verification email to reflect session timeout and product name by @Samuel-Hoskin in #533
• Feature/add sentry by @252afh in #534
• Download Chat Histories by @rachaelcodes in #536
• Enable chat streaming in all tests. by @brunns in #537
• Add eval results visualisation and calculate uncertainty by @esoutter in #538
• Remove streaming demo by @KevinEtchells in #542
• Save non-rag responses to DB - tactical fix. by @brunns in #543
• Feature/semantic routing by @andy-symonds in #540
• Created basic stuff document runnable creation function by @wpfl-dbt in #539
• Feature/naming conventions by @lcardno10 in #548
• bugfix/integration-test-rag-question by @gecBurton in #551
• Enable multi-file uploads by @KevinEtchells in #526
• Fix check-status by @KevinEtchells in #545
• Add Plausible to CSP connect-src by @KevinEtchells in #555
• feature/clustering-on by @gecBurton in #550
• Feature/auto release action by @252afh in #513
• Show ChatMessage date in admin by @rachaelcodes in #557
• REDBOX 337 chat file selection by @brunns in #556
• Turning condensed prompt RAG into a runnable function by @wpfl-dbt in #562
• Turning RAG into a runnable function by @wpfl-dbt in #554
• Only show docs on chat page where processing is complete by @KevinEtchells in #566
• Feature/move secrets to secrets manager by @252afh in #561
• Feature/split rds postgres by @MotwaniM in #571
• REDBOX-337 - Tests for chat file selection by @brunns in #565
• Make chat-history and doc-selection scrollable by @KevinEtchells in #568
• Added summarisation to core api [rebase 2] by @wpfl-dbt in #570
• Increase token limit by @rachaelcodes in #576
• REDBOX-337 Non-streamed chat file selection by @brunns in #578
• Turning chat into a runnable function by @wpfl-dbt in #560
• Feature/stop streaming by @KevinEtchells in #575
• Working condense RAG runnable by @wpfl-dbt in #580
• Feature/dev deployment by @252afh in #567
• Update RAG prompt to remove duplicate sources heading by @rachaelcodes in #582
• Update REST rag_chat endpoint to include the stuff summarisation already in streaming endpoint by @andy-symonds in #584
• Use rb- prefix for Redbox-specific styles by @KevinEtchells in #585
• bugfix/test-summarisation by @gecBurton in #592
• Feature/redbox 362 rag runnable by @jamesrichards4 in #587
• REDBOX 257 - User demographic data by @brunns in #583
• Refactored the chat app to be fastapi dependency based by @jamesrichards4 in #596
• Create loading ellipsis animation and show until streaming complete by @KevinEtchells in #595
• Bump mlflow from 2.12.2 to 2.13.2 in /mlflow in the pip group across 1 directory by @dependabot in #590
• feature/inject-prompts by @gecBurton in #594
• Bump the minor-patch group with 19 updates by @dependabot in #601
• Patches for streaming by @jamesrichards4 in #598
• bugfix/build-fix by @gecBurton in #605

New Contributors

• @dk-singh made their first contribution in #369
• @Samuel-Hoskin made their first contribution in #334
• @esoutter made their first contribution in #478
• @lcardno10 made their first contribution in #548
• @MotwaniM made their first contribution in #571

Full Changelog: 1.0.0...0.3.0