[HOWTO] XenForo attachments via Amazon S3 and CloudFront

http://www.trailpeople.org/attachments/lighthouse-jpg.567/

 

my amazon bucket url is attachments.trailpeople.org - attachments.trailpeople.org.s3.amazonaws.com

 

hi @xfrocks

I have purchased and installed this addon.

I have rebuilt the cache and used this option Update Attachment Data Storage Options to store in my S3 bucket.. it ran without any problem but when i checked in my s3 bucket in AWS console it is showing as empty.....

WHat is the best way to check if this is working or not...?

I uploaded a picture in my XenMediaGallery and got this error

This XML file does not appear to have any style information associated with it. The document tree is shown below.
<Error>
<Code>AccessDenied</Code>
<Message>Access denied</Message>
</Error>

 

[Update] Now i can upload image in xenmediagallery and it is stored in S3/served via cloudfront...


But my basic requirement is not met yet,.... I am trying to off load the existing attachment to s3 and delete those attachment from my server...

What do i have to do?

 

ok just found out i should be using move attachment data...


well.... i get this error when i try to move attachment data

Code:

Server Error

Cannot read file /home/hippy/public_html/mydomain.com/data/attachments/0/225-34da4cccca52686fbe3f605dc9e5f597.jpg

Zend_Service_Amazon_S3->putFile() in bdAttachmentStore/Model/File.php at line 164
bdAttachmentStore_Model_File->_s3_saveFile() in bdAttachmentStore/Model/File.php at line 28
bdAttachmentStore_Model_File->saveFile() in bdAttachmentStore/XenForo/DataWriter/AttachmentData.php at line 145
bdAttachmentStore_XenForo_DataWriter_AttachmentData->_writeAttachmentFile() in XenGallery/DataWriter/AttachmentData.php at line 62
XenGallery_DataWriter_AttachmentData->_writeAttachmentFile() in XenForo/DataWriter/AttachmentData.php at line 159
XenForo_DataWriter_AttachmentData->_postSave() in bdAttachmentStore/XenForo/DataWriter/AttachmentData.php at line 63
bdAttachmentStore_XenForo_DataWriter_AttachmentData->_postSave() in XenForo/DataWriter.php at line 1397
XenForo_DataWriter->save() in bdAttachmentStore/Helper/Mover.php at line 65
bdAttachmentStore_Helper_Mover::move() in bdAttachmentStore/CacheRebuilder/AttachmentData.php at line 55
bdAttachmentStore_CacheRebuilder_AttachmentData->rebuild() in XenForo/ControllerHelper/CacheRebuild.php at line 26
XenForo_ControllerHelper_CacheRebuild->rebuildCache() in XenForo/ControllerAdmin/Tools.php at line 82
XenForo_ControllerAdmin_Tools->actionCacheRebuild() in XenForo/FrontController.php at line 337
XenForo_FrontController->dispatch() in XenForo/FrontController.php at line 134
XenForo_FrontController->run() in /home/hippy/public_html/mydomain.com/admin.php at line 13

 

Hi @xfrocks

One of the issue that has been identified by @MattW is that some of the attachments are not present due to deletion. Can you help me bypass all the deleted attachments and move those which exists presently... Since the lost attachments are quite large i cannot even find the posts where it was inserted...

 

I had migrated server recently and had deleted few attachments which were not a part of this domain name i am using this addon for. So i really dont know the exact issue..

I can pass on the login credentials in private if you could look into it for me..

 

Thanks for the support.... it is done now...

In case others are facing the same issue, reducing the Items to process to 5 solved it for me....

 

I was looking in my attachments folder on the local server, and I found 2 png files in data/attachments/26. Is there a tool that will "fix" this and move them to S3? Also, is there a solution for avatars? I really want to be able to serve all dynamic content via S3/CloudFront.

 

Hi,

I bought and spent nearly half a day to activate this plugin. At the end of the day, I am always getting this error (s3 + CloudFront and I don't have any other addon):

XenForo_Exception: Failed to write the attachment file. - library/XenForo/DataWriter/AttachmentData.php:146
#0 /usr/share/nginx/www/forum/library/bdAttachmentStore/XenForo/DataWriter/AttachmentData.php(55): XenForo_DataWriter_AttachmentData->_postSave()
#1 /usr/share/nginx/www/forum/library/XenForo/DataWriter.php(1409): bdAttachmentStore_XenForo_DataWriter_AttachmentData->_postSave()
#2 /usr/share/nginx/www/forum/library/XenForo/Model/Attachment.php(539): XenForo_DataWriter->save()
#3 /usr/share/nginx/www/forum/library/XenForo/ControllerPublic/Attachment.php(204): XenForo_Model_Attachment->insertUploadedAttachmentData(Object(XenForo_Upload), 1)
#4 /usr/share/nginx/www/forum/library/XenForo/FrontController.php(347): XenForo_ControllerPublic_Attachment->actionDoUpload()
#5 /usr/share/nginx/www/forum/library/XenForo/FrontController.php(134): XenForo_FrontController->dispatch(Object(XenForo_RouteMatch))
#6 /usr/share/nginx/www/forum/index.php(13): XenForo_FrontController->run()
#7 {main}
array(3) {
["url"] => string(110) "http://DOMAINNAME.com/forum/attachm...81a24176881f190aed8101dfd27&content_type=post"
["_GET"] => array(3) {
["/forum/attachments/do-upload_json"] => string(0) ""
["hash"] => string(32) "6cf9f81a24176881f190aed8101dfd27"
["content_type"] => string(4) "post"
}
["_POST"] => array(7) {
["Filename"] => string(13) "kiyaslama.jpg"
["_xfSessionId"] => string(32) "cc9a863d26614b58fa722781f35122dc"
["_xfToken"] => string(8) "********"
["_xfResponseType"] => string(4) "json"
["content_data"] => array(1) {
["node_id"] => string(2) "47"
}
["_xfNoRedirect"] => string(1) "1"
["Upload"] => string(12) "Submit Query"
}
}

 

I got the attachments to work great but how can I get the Avatars to work with this as well?

 

Thank you!

 

Hmm.. I could use a dig out here.

To rule out some security elements I made the Bucket public.
https://attachments.useecloud.com/800px-Polaroid_Sunglasses_logo.png

Couldn't upload .mp4 files to the front end with this plugin enabled.
Uploading images seems ok.

e.g. 800px-Polaroid_Sunglasses_logo.png - OK
Fossetts_2018.mp4 =
The following error occurred
There was a problem uploading your file.

Fossetts 2018.mp4

 

Ok managed to whittle it down and create a new Access Key etc.
How can I make a video that gets uploaded reside in the S3 folder also?