- Mailing Lists
- Contributors
- Reducing the size of a database
Archives
- By thread 1419
-
By date
- August 2019 59
- September 2019 118
- October 2019 165
- November 2019 97
- December 2019 35
- January 2020 58
- February 2020 204
- March 2020 121
- April 2020 172
- May 2020 50
- June 2020 158
- July 2020 85
- August 2020 94
- September 2020 193
- October 2020 277
- November 2020 100
- December 2020 159
- January 2021 38
- February 2021 87
- March 2021 146
- April 2021 73
- May 2021 90
- June 2021 86
- July 2021 123
- August 2021 50
- September 2021 68
- October 2021 66
- November 2021 74
- December 2021 75
- January 2022 98
- February 2022 77
- March 2022 68
- April 2022 31
- May 2022 59
- June 2022 87
- July 2022 141
- August 2022 38
- September 2022 73
- October 2022 152
- November 2022 39
- December 2022 50
- January 2023 93
- February 2023 49
- March 2023 106
- April 2023 47
- May 2023 69
- June 2023 92
- July 2023 64
- August 2023 103
- September 2023 91
- October 2023 101
- November 2023 94
- December 2023 46
- January 2024 75
- February 2024 79
- March 2024 104
- April 2024 63
- May 2024 40
- June 2024 160
- July 2024 80
- August 2024 70
- September 2024 62
- October 2024 121
- November 2024 117
- December 2024 89
- January 2025 59
- February 2025 104
- March 2025 96
- April 2025 107
- May 2025 52
- June 2025 72
- July 2025 60
- August 2025 81
- September 2025 124
- October 2025 63
- November 2025 22
Contributors
Reducing the size of a database
Dear contributors,
Some of our customers have been using their database for more
than 6 years. They want to reduce the size of the database, by
archiving/aggregating old data (accounting entries, sales lines,
stock movements, etc.). It would also be easier to do exports,
pivot tables and so on.
I see different solutions :
1. Manually aggregate old data, with a specific method by type
of tables (account move lines, stock picking, sale order lines).
For instance, aggregate old accounting entries with annual
miscellaneous operations. Of course, we should keep a backup of
the old data somewhere.
2. Mass delete all the old and unused records, such as canceled
POs, articles created by mistake. I don't see a
way to do this quickly.
Maybe an alternative solution would be a
module that sets a "limit date" that acts as an automatic
filter when doing exports, pivots, etc.
Do you know any tool or procedure that would
help with this ?
--
Victor Champonnois - Coop IT Easy
Tel : +32 475 81 01 12
by Victor - 03:21 - 23 Jan 2024
Follow-Ups
-
Re: Reducing the size of a database
Mail message table is typically 50 per cent of database or more. Frankly 6 years is not a lot. In my country fiscal authorities require 7 years, some other legal requirements need 50 years.On Wed, 24 Jan 2024, 5:36 am Holger Brunn, <notifications@odoo-community.org> wrote:> In my experience a > huge amount of records can be deleted by deleting old chatter > records. similar experience here, and for that we have https://github.com/OCA/server-tools/tree/14.0/autovacuum_message_attachment and its migrations to higher versions in the PRs. You should run the third query from https://wiki.postgresql.org/wiki/Disk_Usage anyways to first get an impression where the space goes. -- Your partner for the hard Odoo problems https://hunki-enterprises.com
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
by "Graeme Gellatly" <graeme@moahub.nz> - 09:25 - 23 Jan 2024 -
Re: Reducing the size of a database
> In my experience a > huge amount of records can be deleted by deleting old chatter > records. similar experience here, and for that we have https://github.com/OCA/server-tools/tree/14.0/autovacuum_message_attachment and its migrations to higher versions in the PRs. You should run the third query from https://wiki.postgresql.org/wiki/Disk_Usage anyways to first get an impression where the space goes. -- Your partner for the hard Odoo problems https://hunki-enterprises.com
by Holger Brunn - 05:35 - 23 Jan 2024 -
Re: Reducing the size of a database
Hi,
In my experience a huge amount of records can be deleted by deleting old chatter records.
Kind regards, Ronald
On 23-01-2024 15:57, Florian Laporte wrote:
Dear Victor,
How large are these databases? Database size usually does not become problematic as a result of too many sale orders or stock movements. You would need an insane amount.
If this is the case, and you’ve verified that the size is not caused by large blobs/filestore, the only thing you can do is mass-delete records based on some arbitrary parameter like theircreate_dateorwrite_date. There are many records Odoo won’t let you delete, though. It will ask you to archive them instead, because they are still referenced elsewhere. Archiving will obviously do nothing for database size.Sincerely,
Florian L
On Tue, 23 Jan 2024 at 15:22, Victor Champonnois <notifications@odoo-community.org> wrote:
Dear contributors,
Some of our customers have been using their database for more than 6 years. They want to reduce the size of the database, by archiving/aggregating old data (accounting entries, sales lines, stock movements, etc.). It would also be easier to do exports, pivot tables and so on.
I see different solutions :
1. Manually aggregate old data, with a specific method by type of tables (account move lines, stock picking, sale order lines). For instance, aggregate old accounting entries with annual miscellaneous operations. Of course, we should keep a backup of the old data somewhere.
2. Mass delete all the old and unused records, such as canceled POs, articles created by mistake. I don't see a way to do this quickly.
Maybe an alternative solution would be a module that sets a "limit date" that acts as an automatic filter when doing exports, pivots, etc.
Do you know any tool or procedure that would help with this ?
Best regards,
-- Victor Champonnois - Coop IT Easy Tel : +32 475 81 01 12_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
by "Ronald Portier" <rportier@therp.nl> - 04:21 - 23 Jan 2024 -
Re: Reducing the size of a database
I've seen this module: https://apps.odoo.com/apps/modules/13.0/muk_autovacuum/ Obviously this can't be used on just any models, but for some models I guess such an approach can work. Another idea I've proposed to a customer once, was to have a moment at end of year where you create an "archive copy instance" for that year, where people can login but not change anything. The code at that point is also frozen and copied with. It's a dirty approach, as you'll after N years be sitting with N archive instances, but there's a chance that at some point they'll start agreeing to delete the oldest instance (as at least here in NL, there's a year limit to which you are obliged to keep financial history). The upside to this approach is that you can aggressively start deleting records from live. -Tom
by Tom Blauwendraat - 04:20 - 23 Jan 2024 -
Re: Reducing the size of a database
Dear Victor,
How large are these databases? Database size usually does not become problematic as a result of too many sale orders or stock movements. You would need an insane amount.
If this is the case, and you’ve verified that the size is not caused by large blobs/filestore, the only thing you can do is mass-delete records based on some arbitrary parameter like theircreate_dateorwrite_date. There are many records Odoo won’t let you delete, though. It will ask you to archive them instead, because they are still referenced elsewhere. Archiving will obviously do nothing for database size.Sincerely,
Florian L
On Tue, 23 Jan 2024 at 15:22, Victor Champonnois <notifications@odoo-community.org> wrote:Dear contributors,
Some of our customers have been using their database for more than 6 years. They want to reduce the size of the database, by archiving/aggregating old data (accounting entries, sales lines, stock movements, etc.). It would also be easier to do exports, pivot tables and so on.
I see different solutions :
1. Manually aggregate old data, with a specific method by type of tables (account move lines, stock picking, sale order lines). For instance, aggregate old accounting entries with annual miscellaneous operations. Of course, we should keep a backup of the old data somewhere.
2. Mass delete all the old and unused records, such as canceled POs, articles created by mistake. I don't see a way to do this quickly.
Maybe an alternative solution would be a module that sets a "limit date" that acts as an automatic filter when doing exports, pivots, etc.
Do you know any tool or procedure that would help with this ?
Best regards,
-- Victor Champonnois - Coop IT Easy Tel : +32 475 81 01 12_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
by florian.laporte - 03:56 - 23 Jan 2024