- Mailing Lists
- Contributors
- Increased Queue Job Failures – Need Advice
Archives
- By thread 1419
-
By date
- August 2019 59
- September 2019 118
- October 2019 165
- November 2019 97
- December 2019 35
- January 2020 58
- February 2020 204
- March 2020 121
- April 2020 172
- May 2020 50
- June 2020 158
- July 2020 85
- August 2020 94
- September 2020 193
- October 2020 277
- November 2020 100
- December 2020 159
- January 2021 38
- February 2021 87
- March 2021 146
- April 2021 73
- May 2021 90
- June 2021 86
- July 2021 123
- August 2021 50
- September 2021 68
- October 2021 66
- November 2021 74
- December 2021 75
- January 2022 98
- February 2022 77
- March 2022 68
- April 2022 31
- May 2022 59
- June 2022 87
- July 2022 141
- August 2022 38
- September 2022 73
- October 2022 152
- November 2022 39
- December 2022 50
- January 2023 93
- February 2023 49
- March 2023 106
- April 2023 47
- May 2023 69
- June 2023 92
- July 2023 64
- August 2023 103
- September 2023 91
- October 2023 101
- November 2023 94
- December 2023 46
- January 2024 75
- February 2024 79
- March 2024 104
- April 2024 63
- May 2024 40
- June 2024 160
- July 2024 80
- August 2024 70
- September 2024 62
- October 2024 121
- November 2024 117
- December 2024 89
- January 2025 59
- February 2025 104
- March 2025 96
- April 2025 107
- May 2025 52
- June 2025 72
- July 2025 60
- August 2025 81
- September 2025 124
- October 2025 63
- November 2025 22
Contributors
Increased Queue Job Failures – Need Advice
- psycopg2.errors.InFailedSqlTransaction: current transaction is aborted, commands ignored until end of transaction block
- psycopg2.errors.SerializationFailure: could not serialize access due to concurrent update
by "Emanuel Cino" <emanuel@compassion.ch> - 11:01 - 13 Feb 2025
Follow-Ups
-
Re: Increased Queue Job Failures – Need Advice
I am a big fan ofexcept SerializationFailure as e:
_logger.exception(e)
raise RetryableJobError(e)Beware side effects (third party service calls, file system operations)!On Thu, Feb 13, 2025 at 7:03 AM Jacques-Etienne Baudoux <notifications@odoo-community.org> wrote:Indeed, configure a smaller amount of workers for that specific channel. I think the max retry was not respected in the past, so that failing jobs were always restarted in case of SerializationFailure.Le jeu. 13 févr. 2025 à 11:47, Graeme Gellatly <notifications@odoo-community.org> a écrit :It is a serialization failure. There isn't much (sensible) you can do but use a smaller queue (say 1 channel) for those jobs. If the row is locked or the table is locked, it is locked. If it really matters, and it must be parallel well you need to really dig into the methods, work out when locks are taken, when they are released and optimise the sh!t out of that portion that code. If you can't then you start to get in queuing rights, dropping ACID commitments within transaction etc.On Thu, Feb 13, 2025 at 11:02 PM Emanuel Cino <notifications@odoo-community.org> wrote:Hello everyone,We use queue jobs in our Odoo 14 instance for various operations, and they have worked well so far. However, we've recently noticed an increasing number of failures with the following errors:- psycopg2.errors.InFailedSqlTransaction: current transaction is aborted, commands ignored until end of transaction block
- psycopg2.errors.SerializationFailure: could not serialize access due to concurrent update
This issue may have started after updating the queue_job module to the latest version in branch 14.0, though we're not certain. No other changes have been made to our server configuration.Since we’re unsure how to resolve this, does anyone have experience with this module and the best server configuration for handling parallel job execution? The errors typically occur when multiple jobs run in parallel or when users work on the same models as the running jobs.Any insights or recommendations would be greatly appreciated!Thanks,Emanuel_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
by Adam Heinz - 02:41 - 13 Feb 2025 -
Re: Increased Queue Job Failures – Need Advice
Indeed, configure a smaller amount of workers for that specific channel. I think the max retry was not respected in the past, so that failing jobs were always restarted in case of SerializationFailure.Le jeu. 13 févr. 2025 à 11:47, Graeme Gellatly <notifications@odoo-community.org> a écrit :It is a serialization failure. There isn't much (sensible) you can do but use a smaller queue (say 1 channel) for those jobs. If the row is locked or the table is locked, it is locked. If it really matters, and it must be parallel well you need to really dig into the methods, work out when locks are taken, when they are released and optimise the sh!t out of that portion that code. If you can't then you start to get in queuing rights, dropping ACID commitments within transaction etc.On Thu, Feb 13, 2025 at 11:02 PM Emanuel Cino <notifications@odoo-community.org> wrote:Hello everyone,We use queue jobs in our Odoo 14 instance for various operations, and they have worked well so far. However, we've recently noticed an increasing number of failures with the following errors:- psycopg2.errors.InFailedSqlTransaction: current transaction is aborted, commands ignored until end of transaction block
- psycopg2.errors.SerializationFailure: could not serialize access due to concurrent update
This issue may have started after updating the queue_job module to the latest version in branch 14.0, though we're not certain. No other changes have been made to our server configuration.Since we’re unsure how to resolve this, does anyone have experience with this module and the best server configuration for handling parallel job execution? The errors typically occur when multiple jobs run in parallel or when users work on the same models as the running jobs.Any insights or recommendations would be greatly appreciated!Thanks,Emanuel_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
by Jacques-Etienne Baudoux - 02:01 - 13 Feb 2025 -
Re: Increased Queue Job Failures – Need Advice
It is a serialization failure. There isn't much (sensible) you can do but use a smaller queue (say 1 channel) for those jobs. If the row is locked or the table is locked, it is locked. If it really matters, and it must be parallel well you need to really dig into the methods, work out when locks are taken, when they are released and optimise the sh!t out of that portion that code. If you can't then you start to get in queuing rights, dropping ACID commitments within transaction etc.On Thu, Feb 13, 2025 at 11:02 PM Emanuel Cino <notifications@odoo-community.org> wrote:Hello everyone,We use queue jobs in our Odoo 14 instance for various operations, and they have worked well so far. However, we've recently noticed an increasing number of failures with the following errors:- psycopg2.errors.InFailedSqlTransaction: current transaction is aborted, commands ignored until end of transaction block
- psycopg2.errors.SerializationFailure: could not serialize access due to concurrent update
This issue may have started after updating the queue_job module to the latest version in branch 14.0, though we're not certain. No other changes have been made to our server configuration.Since we’re unsure how to resolve this, does anyone have experience with this module and the best server configuration for handling parallel job execution? The errors typically occur when multiple jobs run in parallel or when users work on the same models as the running jobs.Any insights or recommendations would be greatly appreciated!Thanks,Emanuel_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
by Graeme Gellatly - 11:46 - 13 Feb 2025