Comments (4)
Yeah, there are some shenanigans going on with count, because we calculate it without nesting query inside another select, and because of that we capture some bugs like this on when working with joins
Probably should just wrap all count requests inside outer select count(*)
You can try to make PR about it, or may be I will do it later
from tortoise-orm.
I looked at the definition of the queryset.CountQuery
class and did not understand how to do this in accordance with the existing rules. My subjective experience tells me to simply replace the body of the queryset.QuerySet.count()
method with the body of the example function sql_count()
. Since both approaches query the database with almost identical SQL, it does not look like an overhead, but returning the correct result.
With your permission, I leave this decision within your competence. Thank you for your time.
from tortoise-orm.
Should be fixed on 0.21.0
from tortoise-orm.
This is still broken from my testing:
Complete script to reproduce:
from datetime import datetime, timedelta
from tortoise import Model, run_async, Tortoise, connections, fields
from tortoise.queryset import QuerySet
class User(Model):
id: int = fields.IntField(pk=True)
username: str = fields.CharField(max_length=50, null=True, unique=True)
offers: fields.ReverseRelation["Offer"]
orders: fields.ReverseRelation["Order"]
class Offer(Model):
id: int = fields.IntField(pk=True)
name: str = fields.CharField(max_length=50, null=False)
user: fields.ForeignKeyRelation[User] = fields.ForeignKeyField(
"models.User", related_name="offers"
)
orders: fields.ReverseRelation["Order"]
class Order(Model):
created: datetime = fields.DatetimeField(null=False)
user: fields.ForeignKeyRelation["User"] = fields.ForeignKeyField(
"models.User", related_name="orders"
)
offer: fields.ForeignKeyRelation["Offer"] = fields.ForeignKeyField(
"models.Offer", related_name="orders"
)
async def sql_count(query: QuerySet[Model]) -> int:
_, result = await connections.get("default").execute_query(
f"SELECT count(*) AS total FROM ({query.sql()})"
)
return result[0]["total"]
async def main() -> None:
await Tortoise.init(db_url="sqlite://:memory:", modules={"models": ["__main__"]})
await Tortoise.generate_schemas()
businessman = await User.create(username="businessman")
offer1 = await Offer.create(name="offer1", user=businessman)
offer2 = await Offer.create(name="offer2", user=businessman)
offer3 = await Offer.create(name="offer3", user=businessman)
await User.create(username="client_one")
await User.create(username="client_two")
await User.create(username="client_three")
moment = datetime(2024, 1, 1, 0, 0, 0)
orders = []
for i, offer in enumerate((offer1, offer2, offer3)):
for j in range(3):
orders.append(Order(created=moment, user_id=(j + 2), offer=offer))
moment += timedelta(days=1)
await Order.bulk_create(orders)
query = (
User.filter(
orders__offer__user_id=1
).distinct()
)
result = await query
print(result)
print(await query.count())
print(await sql_count(query))
if __name__ == "__main__":
run_async(main())
Output:
[<User: 2>, <User: 3>, <User: 4>]
9
3
Versions:
pypika-tortoise==0.1.6
tortoise-orm==0.21.3
from tortoise-orm.
Related Issues (20)
- Can anyone tell me how the distinct() function is going to work? HOT 2
- IMMEDIATE transaction type in sqlite
- Cannot have Unittest + Postgres + Fastapi combination. It just doesn't work. HOT 15
- Unexpected keyword argument 'no_delay' HOT 3
- description Attribute Not Effective When db_constraint=False HOT 2
- Function as insert value
- Missing type tags when using async for ... in ... in PyCharm HOT 3
- Tortoise crashes when used with Vercel and FastAPI HOT 1
- 2013, 'Lost connection to MySQL server during query ([Errno 60] Operation timed out)' HOT 1
- model_config Parameter in pydantic_model_creator Not Effective in Sub Models
- Tortoise-ORM executed an update statement, but the data in the database didn't change HOT 1
- Join Function
- NumericField make HOT 5
- Simultaneous get_or_create throws InterfaceError: Pool.release() received invalid connection HOT 2
- [Help]How to initialize tortoise orm in multiple workers? HOT 2
- 关于 Fastapi 使用 TORTOISE_ORM 筛选查询数据时 查询出数据为空的情况 HOT 4
- Migration a model with a ManyToManyfield (MySQL)
- `pydantic_model_creator` should support JSONField annotation (type hints)
- 🐛 Issue: `Model.annotate(...).update(...)` not working
- tortoise.exceptions.ConfigurationError: Can't create schema due to cyclic fk references HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from tortoise-orm.