[bd] Attachment Store for XenForo 1 [Paid] 1.3.7

If it doesn't work together then try the metamirror addon. That works fine.
https://xenforo.com/community/resources/metamirror.2117/

Unmaintained - MetaMirror

This is currently a ONE-WAY conversion of image links from external to local, there is no undo. Make sure you understand this before you install this add-on The ability for users to externally...

xenforo.com

 

so my latest issue is that the move process keeps failing, i've got 117G worth of attachments and its taken over an hour to get to 180MB! can this be run at the command line? any idea why its failing? there nothing in the logs...

 

hi, yeah i've converted 1.4m images ( forum is 16 years old) myself, thats not the issue, its the new stuff that didn't seem to work i find that convertimage doesn't catch everything if a user uploads lots of images, so i use convertimageall to mop up the ones that get missed... i might stop using convertimage and just to a single run of convertimageall once a day.

my issue at the moment is this attachment addon doesn't seem to work, it fails and theres no errors, i'm hoping theres some way to debug it

 

Actually, when I said bd worked perfectly, the end result was perfect, but it did stall more than a few times each day.

After a day or so i started an Amazon server instance and kept an eye on the process via RDP, minimising downtime.

 

Yeah nothing in the logs at all, there's over a million images

 

có thể bảo mật liên kết tải về (ftp) không ad

 

@xfrocks I bought your Attachment Store Addon but having problems to export all internal_data Files in the data Directory in my Testenvironment. after around 30000 Attachments moved it crash and if i want start the rebuild again then the Rebuild Button for Attachment Store is missing.

 

Hi there - I'm running 1.3.0. I need to uninstall it, as my AWS bill was too high. I'm hosting both files on locally, and pushed to S3

How do I uninstall?

These are the steps I've taken so far:
Changed the Default.
Ran tool to update, and nothing seems to update the attachment location.

 

Is this enabled by default?
Where can I see this?

 

There is a conflict between bs attachment store and Lazy Loader:
https://xenforo.com/community/resources/lazy-load-img.3979/

Unmaintained - Lazy Load [img]

Provides lazy loaded image support via the Lazysizes A zero query method for per user-group lazy loading of the [img] and [plain] Enable Outside threads/Conversations permits the lazy loading...

xenforo.com

Thumbs fail for all new images added since I ran the combination of lazy load, attachment improvements and bd attach.
When I disabled lazy load and attachment improvements and rebuild thumbs then everything started working again.

Additionally this causes some flickering of IPs which causes IPs to get banned by our firewall.

 

yeah something's not right. i'm using a different lazy load but disabling it makes no difference - with delayed processing enabled, attachments upload and work briefly before vanishing from the post.


With processing not delayed they can't be uploaded at all and fail with

Code:

The following error occurred
There was a problem uploading your file. 

Rebuilding thumbnails results in many many many of these:

Code:

Error Info
XenForo_Exception: Thumb rebuild for #7553: Failed to write the attachment thumbnail data. - library/XenForo/DataWriter/AttachmentData.php:169
Generated By: admin, A moment ago
Stack Trace
#0 /home/thumped/public_html/bbs/library/bdAttachmentStore/XenForo/DataWriter/AttachmentData.php(54): XenForo_DataWriter_AttachmentData->_postSave()
#1 /home/thumped/public_html/bbs/library/XenForo/DataWriter.php(1423): bdAttachmentStore_XenForo_DataWriter_AttachmentData->_postSave()
#2 /home/thumped/public_html/bbs/library/XenForo/Deferred/AttachmentThumb.php(67): XenForo_DataWriter->save()
#3 /home/thumped/public_html/bbs/library/XenForo/Model/Deferred.php(295): XenForo_Deferred_AttachmentThumb->execute(Array, Array, 7.9999990463257, '')
#4 /home/thumped/public_html/bbs/library/XenForo/Model/Deferred.php(429): XenForo_Model_Deferred->runDeferred(Array, 7.9999990463257, '', false)
#5 /home/thumped/public_html/bbs/library/XenForo/Model/Deferred.php(374): XenForo_Model_Deferred->_runInternal(Array, 8, '', false)
#6 /home/thumped/public_html/bbs/library/XenForo/ControllerAdmin/Tools.php(159): XenForo_Model_Deferred->run(true, NULL, '', false)
#7 /home/thumped/public_html/bbs/library/XenForo/FrontController.php(351): XenForo_ControllerAdmin_Tools->actionRunDeferred()
#8 /home/thumped/public_html/bbs/library/XenForo/FrontController.php(134): XenForo_FrontController->dispatch(Object(XenForo_RouteMatch))
#9 /home/thumped/public_html/bbs/admin.php(13): XenForo_FrontController->run()
#10 {main}
Request State

 

Post removed, @xfrocks answered on xenforo.com. Thank you!

 

Currently running version 1.3.5b, but discovered after updating to version 1.3.4 on December 1, 2017, attachments stopped being moved to the S3 bucket I have set up for them. The last attachment in the S3 bucket is dated 11/30/17, so one could logically assume something went haywire with the 1.3.4 update.

Is there anything in the 1.3.4 code update that you think may have caused the attachments to stop being transferred to S3?

 

This is from the S3 Shippable Helper log. It’s shows the last attachment that moved successfully to S3 on 11/13/17 to the first one that didn’t on 12/7/17. It looks like the “Host” changed between version 1.3.0 to 1.3.4. I hope this helps, so I can get the advice necessary to fix it, whether it’s on my end or yours.

2017-11-13 15:11:21 DELETE http://s3-us-west-2.amazonaws.com:80/st-attach/2017/11/18508_9656a0bfdd5ed58110b951a054241769_thumb.jpgarray (
'x-amz-content-sha256' => 'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855',
'x-amz-date' => '20171113T151121Z',
'Host' => 's3-us-west-2.amazonaws.com',
'Authorization' => 'AWS4-HMAC-SHA256 Credential=XXXXXXXXXXXXX/20171113/us-west-2/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256;x-amz-date,Signature=38a029234ed0f362d093417f1b102abb3db9467a4cf7ac8f3b8044a4a0f52a49',
) -> 204


2017-12-07 19:56:08 PUT http://s3.amazonaws.com:80/st-attach/2017/12/18517_0e84b8c461c62b4404d72b86ebb78314.jpeg array (
'Content-Type' => 'image/jpeg',
'x-amz-acl' => 'public-read',
'Expect' => '100-continue',
'x-amz-content-sha256' => '6bbf5f1c617931ab7bde51738fb49f0928eeefa4ab87b8f1494ee117a5b17474',
'x-amz-date' => '20171207T195607Z',
'Host' => 's3.amazonaws.com',
'Authorization' => 'AWS4-HMAC-SHA256 Credential=XXXXXXXXXXXXXXX/20171207/us-east-1/s3/aws4_request,SignedHeaders=content-type;expect;host;x-amz-acl;x-amz-content-sha256;x-amz-date,Signature=8db89a21dc8024162f5fe0ca6e286658765a08015b9a240350f0e9a4e4d14e1d',
'Content-type' => 'image/jpeg',
) -> 301 <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>PermanentRedirect</Code><Message>The bucket you are attempting to access must be addressed using the specified endpoint. Please send all future requests to this endpoint.</Message><Bucket>st-attach</Bucket><Endpoint>st-attach.s3.amazonaws.com</Endpoint><RequestId>07615445EFA1CFE7</RequestId><HostId>DSgCpuWDm//LAm2ZEUuJxRxmlgFMfEor6lHNWkp9zaACApPN538dagRsVliG4UVlgaeHAqOnXAQ=</HostId></Error>

 

Hi there,

I’ve been trying out the add-on and so far it’s working pretty fine with Amazon S3. One thing I would like to know is if there any way to preserve the filenames of the files uploaded to S3, so instead of having a filename composed by ID_HASH.zip to have the OriginalName.zip. Is there any option or configuration of the module that allows this or can it be done via code?

Best

 

I really need an ASAP solution on this guys https://xfrocks.com/other/threads/bd-attachment-store-paid.58/page-26#post-5814 please

I really need to preserve the filenames of the files uploaded to S3 otherwise i'll have unknown files on S3 and i'll still get charged for old versions