grillazz / fastapi-sqlalchemy-asyncpg Goto Github PK

View Code? Open in Web Editor NEW

345.0 345.0 48.0 7.36 MB

Integration of FastAPI framework supported by Pydantic with SQLAlchemy ORM and PostgreSQL on asyncpg driver

License: MIT License

Dockerfile 2.80% Makefile 4.30% Python 92.15% Mako 0.76%

asyncio asyncpg docker fastapi fastapi-sqlalchemy postgresql pydantic python python3 sqlalchemy

fastapi-sqlalchemy-asyncpg's People

Contributors

Stargazers

Watchers

Forkers

h0rn3t zyxyuanxiao sngnt naisisor abhishektiwari ansrivas bigsas doppleware lchcapitalhumain zerthmonk michaeltoohig copysiter blackhacked z-sector femiayotubosun iamrustamov flyon21 ivangsm frknlbhr kratosacc1 rashid-77 wvsmatvv cjuhlin oyurekten semernyakov nunitelo brianlellis mks313 dbarchuk moigematino lionswerk de1l zxenonx siddharthpandatessell reaxet ashkangoleh lelecanfora levinotik zxvum vhtnguyen buzzandesarrollo yinglancat rox87 sourcery-ai-bot cpaanalytics firdous-bhat aloise

fastapi-sqlalchemy-asyncpg's Issues

SQLAlchemy Engine disposal

I've come across your project and I really appreciate what you've done.
I have a question that bugs me for a long time and I've never seen any project addressing it, including yours.

When you create an AsyncEngine, you are supposed to dispose it, ideally in shutdown event. However, I never see anyone doing it in practice. Is it because you rely on GC of Python to clean it for you?

asyncpg.exceptions._base.InterfaceError: cannot perform operation: another operation is in progress

Hey,
I'm using your boilerplate to setup my fastapi with sqlalchemy and asyncpg.
Now when I do some load testing on my API, after a few concurrent requests , I have the following issue:
asyncpg.exceptions._base.InterfaceError: cannot perform operation: another operation is in progress
How can I prevent this ?
Thanks,
Henry

alembic migration customs

one database many schemas
partitions

example log.ini
https://github.com/RedHatInsights/policies-notifications/blob/master/logging.ini

additional reading

[QUESTION] How to do logging in a FastApi container, any logging does not appear · Issue #19 · tiangolo/uvicorn-gunicorn-fastapi-docker

asgi websockets
redis

low carbon footprint with good cache :)

every database update could trigger refresh of all cache values or clear of all cache values
it can be part of save and update base meths

fastapi-sqlalchemy-asyncpg/app/database.py

Lines 36 to 50 in e71d41a

    
           async def get_async_db() -> AsyncGenerator: 
        
               try: 
        
                   session: AsyncSession = AsyncSessionFactory() 
        
                   logger.debug(f"ASYNC Pool: {engine.pool.status()}") 
        
                   yield session 
        
               except SQLAlchemyError as sql_ex: 
        
                   await session.rollback() 
        
                   raise sql_ex 
        
               except HTTPException as http_ex: 
        
                   await session.rollback() 
        
                   raise http_ex 
        
               else: 
        
                   await session.commit() 
        
               finally: 
        
                   await session.close()

import os
from functools import lru_cache

from pydantic import PostgresDsn, RedisDsn
from pydantic_settings import BaseSettings


class Settings(BaseSettings):
    asyncpg_url: PostgresDsn = os.getenv("SQL_URL")
    secret_key: str = os.getenv("FERNET_KEY")
    redis_url: RedisDsn = os.getenv("REDIS_URL")
    jwt_algorithm: str = os.getenv("JWT_ALGORITHM")
    jwt_expire: int = os.getenv("JWT_EXPIRE")


@lru_cache
def get_settings():
    return Settings()


settings = get_settings()

It's the same as below, I think. Because get_setting() with @lru_cache will always return the same object.:

import os
from functools import lru_cache

from pydantic import PostgresDsn, RedisDsn
from pydantic_settings import BaseSettings


class Settings(BaseSettings):
    asyncpg_url: PostgresDsn = os.getenv("SQL_URL")
    secret_key: str = os.getenv("FERNET_KEY")
    redis_url: RedisDsn = os.getenv("REDIS_URL")
    jwt_algorithm: str = os.getenv("JWT_ALGORITHM")
    jwt_expire: int = os.getenv("JWT_EXPIRE")


settings = Setting()

	async def get_async_db() -> AsyncGenerator:
	try:
	session: AsyncSession = AsyncSessionFactory()
	logger.debug(f"ASYNC Pool: {engine.pool.status()}")
	yield session
	except SQLAlchemyError as sql_ex:
	await session.rollback()
	raise sql_ex
	except HTTPException as http_ex:
	await session.rollback()
	raise http_ex
	else:
	await session.commit()
	finally:
	await session.close()