Archives
Contributors
FOSDEM Call for Participation: would OCA contributors join? + OCA Code Sprint in Brussels
OCA Codesprint - around FOSDEM - are you keen?
Store large Size videos
Does anyone have experience with storing very large video files (e.g., 1-hour-long, few GB) in the Odoo file system or an external drive?
Our use case involves an Odoo website with Videos, and we're trying to avoid embedding videos from external platforms like YouTube.
Thanks
by Hed Shefer - 02:41 - 20 Nov 2024
Follow-Ups
-
Re: Store large Size videos
Dear Hed Shefer,
If you need an ultimate solution you can have mine solution to deal with very big files.
I have been storing large videos outside of YouTube and displaying them in odoo blog.
You are my brother
Best
On Thu, Nov 21, 2024, 18:49 mohamed alkobrosly <alkobroslymohamed@gmail.com> wrote:Dear Graeme,
If you need an ultimate solution you can have mine solution to deal with very big files.
I have been storing large videos outside of YouTube and displaying them in odoo blog.
You are my brother
Best
On Wed, Nov 20, 2024, 23:38 Graeme Gellatly <notifications@odoo-community.org> wrote:Very interesting. So the issue isn't actually s3 per se, it is Odoo's file handling which seems to at least be on the radar/partially addressed by the OCA/storage team. Will watch with interest.On Thu, Nov 21, 2024 at 9:02 AM Axel Mendoza <notifications@odoo-community.org> wrote:I have used attachment_s3 and other approaches in the past and they aren't good options for handling big files. Every time you give a big file to Odoo it's a bad experience. No streaming, high memory usage, slow manipulation. I have even implemented an streaming google drive file type to avoid odoo issues with big files and it's better but too complex solution because of all routes that need to create to handle everything and not as good as directly upload and download from S3 buckets without giving the files to OdooMsc. Axel Mendoza PupoOn Wed, Nov 20, 2024 at 1:47 PM Graeme Gellatly <notifications@odoo-community.org> wrote:Hi,Why go to all that trouble? What advantage does doing all that give over the commonly used attachment_s3?On Thu, Nov 21, 2024 at 7:52 AM Axel Mendoza <notifications@odoo-community.org> wrote:It's a combination of deployment strategies where the odoo filestore is mounted into the local filesystem as FUSE. The attachment is created empty in Odoo to get the store_fname location into the S3 Bucket and then the upload action is pre-signed to allow the user upload the files directly into S3 uri location and all the operations that involve the usage of the file is also pre-signed so the user will be able to view it, download and even edit it using online tools for some file types like using google docs or microsoft office online. For Odoo the file lives in the filestore but the filestore is remote in an S3 bucketMsc. Axel Mendoza PupoOn Wed, Nov 20, 2024 at 11:57 AM Hed Shefer <notifications@odoo-community.org> wrote:Great!And how was the integration after loading to aws S3? Did you fetch the files to the odoo website page without issues?בתאריך יום ד׳, 20 בנוב׳ 2024, 19:38, מאת Axel Mendoza <notifications@odoo-community.org>:HelloI have experience directly uploading big files to AWS S3 and also integrated with Odoo. You should avoid at all cost to give Odoo the file since it will load it completely in memory and it will be very slow and could easily crash for big filesMsc. Axel Mendoza PupoOn Wed, Nov 20, 2024 at 11:27 AM Roussel, Denis <notifications@odoo-community.org> wrote:Hi Hed,I suggest you to check fs_storage module: https://github.com/OCA/storage/tree/16.0/fs_storage
It supports external storages as S3, ...Regards,On Wed, Nov 20, 2024 at 2:42 PM Hed Shefer <notifications@odoo-community.org> wrote:Hi everyone,
Does anyone have experience with storing very large video files (e.g., 1-hour-long, few GB) in the Odoo file system or an external drive?
Our use case involves an Odoo website with Videos, and we're trying to avoid embedding videos from external platforms like YouTube.
Thanks_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
by Mohamed Alkobrosly - 04:56 - 21 Nov 2024 -
Re: Store large Size videos
Dear Graeme,
If you need an ultimate solution you can have mine solution to deal with very big files.
I have been storing large videos outside of YouTube and displaying them in odoo blog.
You are my brother
Best
On Wed, Nov 20, 2024, 23:38 Graeme Gellatly <notifications@odoo-community.org> wrote:Very interesting. So the issue isn't actually s3 per se, it is Odoo's file handling which seems to at least be on the radar/partially addressed by the OCA/storage team. Will watch with interest.On Thu, Nov 21, 2024 at 9:02 AM Axel Mendoza <notifications@odoo-community.org> wrote:I have used attachment_s3 and other approaches in the past and they aren't good options for handling big files. Every time you give a big file to Odoo it's a bad experience. No streaming, high memory usage, slow manipulation. I have even implemented an streaming google drive file type to avoid odoo issues with big files and it's better but too complex solution because of all routes that need to create to handle everything and not as good as directly upload and download from S3 buckets without giving the files to OdooMsc. Axel Mendoza PupoOn Wed, Nov 20, 2024 at 1:47 PM Graeme Gellatly <notifications@odoo-community.org> wrote:Hi,Why go to all that trouble? What advantage does doing all that give over the commonly used attachment_s3?On Thu, Nov 21, 2024 at 7:52 AM Axel Mendoza <notifications@odoo-community.org> wrote:It's a combination of deployment strategies where the odoo filestore is mounted into the local filesystem as FUSE. The attachment is created empty in Odoo to get the store_fname location into the S3 Bucket and then the upload action is pre-signed to allow the user upload the files directly into S3 uri location and all the operations that involve the usage of the file is also pre-signed so the user will be able to view it, download and even edit it using online tools for some file types like using google docs or microsoft office online. For Odoo the file lives in the filestore but the filestore is remote in an S3 bucketMsc. Axel Mendoza PupoOn Wed, Nov 20, 2024 at 11:57 AM Hed Shefer <notifications@odoo-community.org> wrote:Great!And how was the integration after loading to aws S3? Did you fetch the files to the odoo website page without issues?בתאריך יום ד׳, 20 בנוב׳ 2024, 19:38, מאת Axel Mendoza <notifications@odoo-community.org>:HelloI have experience directly uploading big files to AWS S3 and also integrated with Odoo. You should avoid at all cost to give Odoo the file since it will load it completely in memory and it will be very slow and could easily crash for big filesMsc. Axel Mendoza PupoOn Wed, Nov 20, 2024 at 11:27 AM Roussel, Denis <notifications@odoo-community.org> wrote:Hi Hed,I suggest you to check fs_storage module: https://github.com/OCA/storage/tree/16.0/fs_storage
It supports external storages as S3, ...Regards,On Wed, Nov 20, 2024 at 2:42 PM Hed Shefer <notifications@odoo-community.org> wrote:Hi everyone,
Does anyone have experience with storing very large video files (e.g., 1-hour-long, few GB) in the Odoo file system or an external drive?
Our use case involves an Odoo website with Videos, and we're trying to avoid embedding videos from external platforms like YouTube.
Thanks_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
by Mohamed Alkobrosly - 04:51 - 21 Nov 2024 -
Re: Store large Size videos
Very interesting. So the issue isn't actually s3 per se, it is Odoo's file handling which seems to at least be on the radar/partially addressed by the OCA/storage team. Will watch with interest.On Thu, Nov 21, 2024 at 9:02 AM Axel Mendoza <notifications@odoo-community.org> wrote:I have used attachment_s3 and other approaches in the past and they aren't good options for handling big files. Every time you give a big file to Odoo it's a bad experience. No streaming, high memory usage, slow manipulation. I have even implemented an streaming google drive file type to avoid odoo issues with big files and it's better but too complex solution because of all routes that need to create to handle everything and not as good as directly upload and download from S3 buckets without giving the files to OdooMsc. Axel Mendoza PupoOn Wed, Nov 20, 2024 at 1:47 PM Graeme Gellatly <notifications@odoo-community.org> wrote:Hi,Why go to all that trouble? What advantage does doing all that give over the commonly used attachment_s3?On Thu, Nov 21, 2024 at 7:52 AM Axel Mendoza <notifications@odoo-community.org> wrote:It's a combination of deployment strategies where the odoo filestore is mounted into the local filesystem as FUSE. The attachment is created empty in Odoo to get the store_fname location into the S3 Bucket and then the upload action is pre-signed to allow the user upload the files directly into S3 uri location and all the operations that involve the usage of the file is also pre-signed so the user will be able to view it, download and even edit it using online tools for some file types like using google docs or microsoft office online. For Odoo the file lives in the filestore but the filestore is remote in an S3 bucketMsc. Axel Mendoza PupoOn Wed, Nov 20, 2024 at 11:57 AM Hed Shefer <notifications@odoo-community.org> wrote:Great!And how was the integration after loading to aws S3? Did you fetch the files to the odoo website page without issues?בתאריך יום ד׳, 20 בנוב׳ 2024, 19:38, מאת Axel Mendoza <notifications@odoo-community.org>:HelloI have experience directly uploading big files to AWS S3 and also integrated with Odoo. You should avoid at all cost to give Odoo the file since it will load it completely in memory and it will be very slow and could easily crash for big filesMsc. Axel Mendoza PupoOn Wed, Nov 20, 2024 at 11:27 AM Roussel, Denis <notifications@odoo-community.org> wrote:Hi Hed,I suggest you to check fs_storage module: https://github.com/OCA/storage/tree/16.0/fs_storage
It supports external storages as S3, ...Regards,On Wed, Nov 20, 2024 at 2:42 PM Hed Shefer <notifications@odoo-community.org> wrote:Hi everyone,
Does anyone have experience with storing very large video files (e.g., 1-hour-long, few GB) in the Odoo file system or an external drive?
Our use case involves an Odoo website with Videos, and we're trying to avoid embedding videos from external platforms like YouTube.
Thanks_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
by Graeme Gellatly - 09:36 - 20 Nov 2024 -
Re: Store large Size videos
I have used attachment_s3 and other approaches in the past and they aren't good options for handling big files. Every time you give a big file to Odoo it's a bad experience. No streaming, high memory usage, slow manipulation. I have even implemented an streaming google drive file type to avoid odoo issues with big files and it's better but too complex solution because of all routes that need to create to handle everything and not as good as directly upload and download from S3 buckets without giving the files to OdooMsc. Axel Mendoza PupoOn Wed, Nov 20, 2024 at 1:47 PM Graeme Gellatly <notifications@odoo-community.org> wrote:Hi,Why go to all that trouble? What advantage does doing all that give over the commonly used attachment_s3?On Thu, Nov 21, 2024 at 7:52 AM Axel Mendoza <notifications@odoo-community.org> wrote:It's a combination of deployment strategies where the odoo filestore is mounted into the local filesystem as FUSE. The attachment is created empty in Odoo to get the store_fname location into the S3 Bucket and then the upload action is pre-signed to allow the user upload the files directly into S3 uri location and all the operations that involve the usage of the file is also pre-signed so the user will be able to view it, download and even edit it using online tools for some file types like using google docs or microsoft office online. For Odoo the file lives in the filestore but the filestore is remote in an S3 bucketMsc. Axel Mendoza PupoOn Wed, Nov 20, 2024 at 11:57 AM Hed Shefer <notifications@odoo-community.org> wrote:Great!And how was the integration after loading to aws S3? Did you fetch the files to the odoo website page without issues?בתאריך יום ד׳, 20 בנוב׳ 2024, 19:38, מאת Axel Mendoza <notifications@odoo-community.org>:HelloI have experience directly uploading big files to AWS S3 and also integrated with Odoo. You should avoid at all cost to give Odoo the file since it will load it completely in memory and it will be very slow and could easily crash for big filesMsc. Axel Mendoza PupoOn Wed, Nov 20, 2024 at 11:27 AM Roussel, Denis <notifications@odoo-community.org> wrote:Hi Hed,I suggest you to check fs_storage module: https://github.com/OCA/storage/tree/16.0/fs_storage
It supports external storages as S3, ...Regards,On Wed, Nov 20, 2024 at 2:42 PM Hed Shefer <notifications@odoo-community.org> wrote:Hi everyone,
Does anyone have experience with storing very large video files (e.g., 1-hour-long, few GB) in the Odoo file system or an external drive?
Our use case involves an Odoo website with Videos, and we're trying to avoid embedding videos from external platforms like YouTube.
Thanks_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
by Axel Mendoza - 09:01 - 20 Nov 2024 -
Re: Store large Size videos
Hi,Why go to all that trouble? What advantage does doing all that give over the commonly used attachment_s3?On Thu, Nov 21, 2024 at 7:52 AM Axel Mendoza <notifications@odoo-community.org> wrote:It's a combination of deployment strategies where the odoo filestore is mounted into the local filesystem as FUSE. The attachment is created empty in Odoo to get the store_fname location into the S3 Bucket and then the upload action is pre-signed to allow the user upload the files directly into S3 uri location and all the operations that involve the usage of the file is also pre-signed so the user will be able to view it, download and even edit it using online tools for some file types like using google docs or microsoft office online. For Odoo the file lives in the filestore but the filestore is remote in an S3 bucketMsc. Axel Mendoza PupoOn Wed, Nov 20, 2024 at 11:57 AM Hed Shefer <notifications@odoo-community.org> wrote:Great!And how was the integration after loading to aws S3? Did you fetch the files to the odoo website page without issues?בתאריך יום ד׳, 20 בנוב׳ 2024, 19:38, מאת Axel Mendoza <notifications@odoo-community.org>:HelloI have experience directly uploading big files to AWS S3 and also integrated with Odoo. You should avoid at all cost to give Odoo the file since it will load it completely in memory and it will be very slow and could easily crash for big filesMsc. Axel Mendoza PupoOn Wed, Nov 20, 2024 at 11:27 AM Roussel, Denis <notifications@odoo-community.org> wrote:Hi Hed,I suggest you to check fs_storage module: https://github.com/OCA/storage/tree/16.0/fs_storage
It supports external storages as S3, ...Regards,On Wed, Nov 20, 2024 at 2:42 PM Hed Shefer <notifications@odoo-community.org> wrote:Hi everyone,
Does anyone have experience with storing very large video files (e.g., 1-hour-long, few GB) in the Odoo file system or an external drive?
Our use case involves an Odoo website with Videos, and we're trying to avoid embedding videos from external platforms like YouTube.
Thanks_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
_______________________________________________
Mailing-List: https://odoo-community.org/groups/contributors-15
Post to: mailto:contributors@odoo-community.org
Unsubscribe: https://odoo-community.org/groups?unsubscribe
by Graeme Gellatly - 08:46 - 20 Nov 2024