Expression tree is too large (maximum depth 1000)

[mabroens]

Please verify that this bug has NOT been raised before.

• I checked and didn't find a similar issue

Describe the bug*

When processing an order with more that 1000 items we get an error:

in the admin center i can see following:

Traceback (most recent call last):

File "/opt/inventree/env/lib/python3.12/site-packages/django/db/backends/utils.py", line 105, in _execute

return self.cursor.execute(sql, params)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/opt/inventree/env/lib/python3.12/site-packages/django/db/backends/sqlite3/base.py", line 360, in execute

return super().execute(query, params)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

sqlite3.OperationalError: Expression tree is too large (maximum depth 1000)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):

File "/opt/inventree/env/lib/python3.12/site-packages/rest_framework/views.py", line 512, in dispatch

response = handler(request, *args, **kwargs)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/opt/inventree/env/lib/python3.12/site-packages/drf_spectacular/drainage.py", line 207, in wrapped_method

return method(self, request, *args, **kwargs)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/opt/inventree/src/backend/InvenTree/data_exporter/mixins.py", line 494, in get

return super().get(request, *args, **kwargs)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/opt/inventree/env/lib/python3.12/site-packages/rest_framework/generics.py", line 243, in get

return self.list(request, *args, **kwargs)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/opt/inventree/env/lib/python3.12/site-packages/rest_framework/mixins.py", line 40, in list

page = self.paginate_queryset(queryset)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/opt/inventree/env/lib/python3.12/site-packages/rest_framework/generics.py", line 175, in paginate_queryset

return self.paginator.paginate_queryset(queryset, self.request, view=self)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/opt/inventree/env/lib/python3.12/site-packages/rest_framework/pagination.py", line 362, in paginate_queryset

return list(queryset[self.offset:self.offset + self.limit])

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/opt/inventree/env/lib/python3.12/site-packages/django/db/models/query.py", line 386, in __iter__

self._fetch_all()

File "/opt/inventree/env/lib/python3.12/site-packages/django/db/models/query.py", line 1956, in _fetch_all

self._prefetch_related_objects()

File "/opt/inventree/env/lib/python3.12/site-packages/django/db/models/query.py", line 1330, in _prefetch_related_objects

prefetch_related_objects(self._result_cache, *self._prefetch_related_lookups)

File "/opt/inventree/env/lib/python3.12/site-packages/django/db/models/query.py", line 2408, in prefetch_related_objects

obj_list, additional_lookups = prefetch_one_level(

^^^^^^^^^^^^^^^^^^^

File "/opt/inventree/env/lib/python3.12/site-packages/django/db/models/query.py", line 2609, in prefetch_one_level

all_related_objects = list(rel_qs)

^^^^^^^^^^^^

File "/opt/inventree/env/lib/python3.12/site-packages/django/db/models/query.py", line 386, in __iter__

self._fetch_all()

File "/opt/inventree/env/lib/python3.12/site-packages/django/db/models/query.py", line 1954, in _fetch_all

self._result_cache = list(self._iterable_class(self))

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/opt/inventree/env/lib/python3.12/site-packages/django/db/models/query.py", line 93, in __iter__

results = compiler.execute_sql(

^^^^^^^^^^^^^^^^^^^^^

File "/opt/inventree/env/lib/python3.12/site-packages/django/db/models/sql/compiler.py", line 1623, in execute_sql

cursor.execute(sql, params)

File "/opt/inventree/env/lib/python3.12/site-packages/django/db/backends/utils.py", line 122, in execute

return super().execute(sql, params)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/opt/inventree/env/lib/python3.12/site-packages/django/db/backends/utils.py", line 79, in execute

return self._execute_with_wrappers(

^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/opt/inventree/env/lib/python3.12/site-packages/django/db/backends/utils.py", line 92, in _execute_with_wrappers

return executor(sql, params, many, context)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/opt/inventree/env/lib/python3.12/site-packages/django/db/backends/utils.py", line 100, in _execute

with self.db.wrap_database_errors:

File "/opt/inventree/env/lib/python3.12/site-packages/django/db/utils.py", line 91, in __exit__

raise dj_exc_value.with_traceback(traceback) from exc_value

File "/opt/inventree/env/lib/python3.12/site-packages/django/db/backends/utils.py", line 105, in _execute

return self.cursor.execute(sql, params)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/opt/inventree/env/lib/python3.12/site-packages/django/db/backends/sqlite3/base.py", line 360, in execute

return super().execute(query, params)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

django.db.utils.OperationalError: Expression tree is too large (maximum depth 1000)

Steps to Reproduce

just click refresh page

Expected behaviour

no limitations

Deployment Method

None

Version Information

Try to reproduce on the demo site

I did not try to reproduce

Is the bug reproducible on the demo site?

Not reproducible

Relevant log output

[matmair]

Running that size of deployment on SQLite is not possible, you are running into limits of the SQLite engine, switch to Postgres or mariaDB

[matmair]

Filling out deployment method or providing the full version information would help with providing more concrete steps; with the given set of infos that is all we can say about this

[mabroens]

Dear Matmair,

Thanks for the response. If i read it correct there is an issue with sqlnlite and i would need to switch to another dB.

Can you provide instructions how to do this and how to migrate my current db? I am a user unfortunately not a developer at this level.

Also you need more information from me? Please tell me what you need and how i can obtain it from the ubuntu machine.

Br martijn broens

[matmair]

@mabroens there is an explicit "Deployment Method" section in the template; provide information on how you set up this instance; which guides you followed; which of the offered methods you used.
I do not know your environment, I can not tell you what you did on your machine to get InvenTree on it.

What you need to do to switch DBs will differ depending on the method. I generally do not recommend running a service for business critical services without someone properly qualified ensuring operations and backups are following best practices. A server without regularly tested BCMS will cause issues some day.

[newfolder0]

Tickets like this make me think that InvenTree has grown to the point where there is a hole in the market for someone to offer it as a SaaS product on a managed server.

I, for one, would be really happy to pay for this rather than run it myself (hah).
This software is giving real value to a bunch of businesses (kudos to the devs) and offsetting the labour cost of self-hosting would justify a pretty decent per-company subscription fee.

I'm curious, is there any interest from any of the devs in ever doing this? Surely you've thought about it.
You could offer managed InvenTree instances on VMs for a monthly subscription, with a robust backup scheme and BCMS strategy behind it.
Seems to me that it could make a solid business and use it as a tool to fund development (re-invest the profit in paying a salary to a developer in order to continue working on and improving the open source core project).
I'm looking to KiPro for inspiration (https://www.kipro-pcb.com/support-services/), who offer a "customer support package" for KiCAD (open source) without compromising the open source nature of the core project and allowing paying customers to fund specific development that suits their needs, but can then be released back to the community in the main GitHub branch if it's useful to others.

Usual disclaimer: I'm not an expert and I don't pretend to have any right to demand anything from the InvenTree devs. I just really like InvenTree and I'm basically supporting it for one of my clients... and I think someone else could do a better job of the sysadmin side of things (I can get by but it's really not my expertise).

I'm an independent consultant, I have a lot of flexibility to work on what I want, so I could help in places where I have the right skills... and InvenTree fills a niche that offers real value to the electronics industry (again, awesome work to the devs).
If there's any interest from the existing devs I would be willing to support the concept - exactly how, TBD. I'm also not interested in trying to do it myself, especially not alone (firstly because it feels dodgy to profit from open source software I haven't even contributed to, secondly because I am missing some of the necessary skills). I'd be really happy if someone else went off and did it, but I'd also be happy to help make it happen if someone is already thinking about it and I can help to tip the scales.

TL;DR: InvenTree managed SaaS: has it been considered by the active developers, and if not, are any of you interested in having a "zoom coffee" to chat about it?

[matmair]

@newfolder0 i would mostly appreciate keeping the issue tracker on topic
Several businesses offer managed InvenTree. With very limited success from what I heard.