Vicky Guo 829472a1d7 switch to diffy_config with Pydantic in files, moderation and app (#6747) 9 hónapja%!(EXTRA string=óta)
..
advanced_chat 5e6fc58db3 Feat/environment variables in workflow (#6515) 9 hónapja%!(EXTRA string=óta)
agent_chat dcb72e0067 chore: apply flake8-comprehensions Ruff rules to improve collection comprehensions (#5652) 10 hónapja%!(EXTRA string=óta)
chat dcb72e0067 chore: apply flake8-comprehensions Ruff rules to improve collection comprehensions (#5652) 10 hónapja%!(EXTRA string=óta)
completion 4e2de638af feat: add ops trace (#5483) 10 hónapja%!(EXTRA string=óta)
workflow 5e6fc58db3 Feat/environment variables in workflow (#6515) 9 hónapja%!(EXTRA string=óta)
README.md 7753ba2d37 FEAT: NEW WORKFLOW ENGINE (#3160) 1 éve%!(EXTRA string=óta)
__init__.py 7753ba2d37 FEAT: NEW WORKFLOW ENGINE (#3160) 1 éve%!(EXTRA string=óta)
base_app_generate_response_converter.py 5e6fc58db3 Feat/environment variables in workflow (#6515) 9 hónapja%!(EXTRA string=óta)
base_app_generator.py 66a62e6c13 refactor(api/core/app/apps/base_app_generator.py): improve input validation and sanitization in BaseAppGenerator (#5866) 10 hónapja%!(EXTRA string=óta)
base_app_queue_manager.py 829472a1d7 switch to diffy_config with Pydantic in files, moderation and app (#6747) 9 hónapja%!(EXTRA string=óta)
base_app_runner.py 4e2de638af feat: add ops trace (#5483) 10 hónapja%!(EXTRA string=óta)
message_based_app_generator.py 4e2de638af feat: add ops trace (#5483) 10 hónapja%!(EXTRA string=óta)
message_based_app_queue_manager.py 7753ba2d37 FEAT: NEW WORKFLOW ENGINE (#3160) 1 éve%!(EXTRA string=óta)
workflow_logging_callback.py 5e6fc58db3 Feat/environment variables in workflow (#6515) 9 hónapja%!(EXTRA string=óta)

README.md

Guidelines for Database Connection Management in App Runner and Task Pipeline

Due to the presence of tasks in App Runner that require long execution times, such as LLM generation and external requests, Flask-Sqlalchemy's strategy for database connection pooling is to allocate one connection (transaction) per request. This approach keeps a connection occupied even during non-DB tasks, leading to the inability to acquire new connections during high concurrency requests due to multiple long-running tasks.

Therefore, the database operations in App Runner and Task Pipeline must ensure connections are closed immediately after use, and it's better to pass IDs rather than Model objects to avoid deattach errors.

Examples:

  1. Creating a new record:
   app = App(id=1)
   db.session.add(app)
   db.session.commit()
   db.session.refresh(app)  # Retrieve table default values, like created_at, cached in the app object, won't affect after close
   
   # Handle non-long-running tasks or store the content of the App instance in memory (via variable assignment).
   
   db.session.close()
   
   return app.id
  1. Fetching a record from the table:
   app = db.session.query(App).filter(App.id == app_id).first()
    
   created_at = app.created_at
    
   db.session.close()
   
   # Handle tasks (include long-running).
   
  1. Updating a table field:
   app = db.session.query(App).filter(App.id == app_id).first()

   app.updated_at = time.utcnow()
   db.session.commit()
   db.session.close()

   return app_id