takatost 4a031de0d9 feat: make Citations and Attributions display enable default (#5508) 1 год назад
..
advanced_chat 4a031de0d9 feat: make Citations and Attributions display enable default (#5508) 1 год назад
agent_chat 4a031de0d9 feat: make Citations and Attributions display enable default (#5508) 1 год назад
chat 4a031de0d9 feat: make Citations and Attributions display enable default (#5508) 1 год назад
completion 415022aa14 fix: pydantic2 error (#5172) 1 год назад
workflow e852a21634 Feat/workflow phase2 (#4687) 1 год назад
README.md 7753ba2d37 FEAT: NEW WORKFLOW ENGINE (#3160) 1 год назад
__init__.py 7753ba2d37 FEAT: NEW WORKFLOW ENGINE (#3160) 1 год назад
base_app_generate_response_converter.py e02ee3bb2e fix event/stream ping (#3553) 1 год назад
base_app_generator.py c2f0f958ef fix: passing in 0 as a numeric variable will be converted to null (#4148) 1 год назад
base_app_queue_manager.py f976740b57 improve: mordernizing validation by migrating pydantic from 1.x to 2.x (#4592) 1 год назад
base_app_runner.py f976740b57 improve: mordernizing validation by migrating pydantic from 1.x to 2.x (#4592) 1 год назад
message_based_app_generator.py f976740b57 improve: mordernizing validation by migrating pydantic from 1.x to 2.x (#4592) 1 год назад
message_based_app_queue_manager.py 7753ba2d37 FEAT: NEW WORKFLOW ENGINE (#3160) 1 год назад
workflow_logging_callback.py e852a21634 Feat/workflow phase2 (#4687) 1 год назад

README.md

Guidelines for Database Connection Management in App Runner and Task Pipeline

Due to the presence of tasks in App Runner that require long execution times, such as LLM generation and external requests, Flask-Sqlalchemy's strategy for database connection pooling is to allocate one connection (transaction) per request. This approach keeps a connection occupied even during non-DB tasks, leading to the inability to acquire new connections during high concurrency requests due to multiple long-running tasks.

Therefore, the database operations in App Runner and Task Pipeline must ensure connections are closed immediately after use, and it's better to pass IDs rather than Model objects to avoid deattach errors.

Examples:

  1. Creating a new record:
   app = App(id=1)
   db.session.add(app)
   db.session.commit()
   db.session.refresh(app)  # Retrieve table default values, like created_at, cached in the app object, won't affect after close
   
   # Handle non-long-running tasks or store the content of the App instance in memory (via variable assignment).
   
   db.session.close()
   
   return app.id
  1. Fetching a record from the table:
   app = db.session.query(App).filter(App.id == app_id).first()
    
   created_at = app.created_at
    
   db.session.close()
   
   # Handle tasks (include long-running).
   
  1. Updating a table field:
   app = db.session.query(App).filter(App.id == app_id).first()

   app.updated_at = time.utcnow()
   db.session.commit()
   db.session.close()

   return app_id