[bd] Data Storage [Paid] 1.2.5b

Store data in remote servers.

  1. Vietnamese

    Vietnamese New Member

    Ngoài ra thì sau khi cái addons này file temp tăng lên mấy GB trong vòng 1 ngày, không biết khắc phục ntn ?
     
  2. jjff

    jjff New Member

    Hi, I bought this addon but it doesn't seem to do any thing.

    The instructions say I should upload the images to S3 myself, I did that via sync and then configured this add-on but it does absolutely nothing....

    What's the purpose of this addon? Is it required for Attachment Store? Am I using this wrong? Where is the configuration in the ACP?

    Thank you.
     
    1. xfrocks

      xfrocks XenForo rocks!
      Staff Member

      xfrocks @jjff Remote configuration is put in config.php. It has to be done that way because by the time XenForo options system is loaded, it's already too late.
      When you say "it does nothing", have you modified your config.php for S3? When you upload new avatar, is it uploaded to S3?
      This add-on is not required to use [bd] Attachment Store. They works independently and does different things.
       
  3. jjff

    jjff New Member

    So this addon is just for avatars and attachment store is for attachments?
     
    1. xfrocks

      xfrocks XenForo rocks!
      Staff Member

      xfrocks @jjff By default: this add-on handles avatars and attachment thumbnail. Normally, other add-ons will put their files into /data and those will be handled by this add-on too.

      [bd] Attachment Store works exclusively with attachment (both thumbnail and full file). If you have both add-on installed, attachment thumbnail will be managed by [bd] Attachment Store.
       
  4. Dryline

    Dryline New Member

    After installing this app, I'm seeing quite a few errors in the server log.

    Code:
    Zend_Http_Client_Adapter_Exception: Unable to Connect to tcp://s3-us-west-2.amazonaws.com:80. Error #110: Connection timed out - library/Zend/Http/Client/Adapter/Socket.php:235
    
    ErrorException: fopen(/usr/docroot/stormtrack.org/community/internal_data/temp/bddss3df_k1yxXx): failed to open stream: No such file or directory -library/bdDataStorage/StreamWrapper/Abstract.php:533
    
    ErrorException: getimagesize(): Read error! - library/XenGallery/Helper/Image.php:84
    
    ErrorException: copy(/youtube_b-I7TlKzD9A_thumb.jpg): failed to open stream: Permission denied - library/XenGallery/Helper/Image.php:994
    
    Also, here is a link to page with broken images. I confirmed that the broken thumbnails are not in the S3 bucket.
    http://stormtrack.org/community/find-new/330292/media

    I have [bd] Cache installed as well and I'm wondering if that could be interfering with this plugin. Please advise.
     
  5. Dryline

    Dryline New Member

    Update - any advice on my above post @xfrocks? Our progress on site improvements depend on getting this resolved. Were going on 36 hours at this point. If you need more information please let me know.
     
    1. xfrocks

      xfrocks XenForo rocks!
      Staff Member

      xfrocks @Dryline Sorry for the late response, I have replied to your message on xenforo.com though. Anyway, it looks like a network issue and you can try to rerun the thumbnail builder.
       
  6. xfrocks

    xfrocks XenForo rocks!
    Staff Member

    xfrocks updated [bd] Data Storage with a new update entry:

    Minor Update

    Read the rest of this update entry...
     
  7. xfrocks

    xfrocks XenForo rocks!
    Staff Member

  8. nhatkymua

    nhatkymua New Member

    bị báo lỗi "AccessDenied" từ amazon s3 , nên không truy cập đc ảnh, sửa làm sao bạn?
    Với nếu làm internal_data cho lên s3 được luôn thì hay biết mấy
     
    1. xfrocks

      xfrocks XenForo rocks!
      Staff Member

      xfrocks @nhatkymua Bạn kiểm tra lại cấu hình trong config.php xem mục ACL đang để là gì nhé. Nếu có thể copy đăng lên thì tiện nhất (lưu ý xóa bỏ phần thông tin key/secret).
       
      nhatkymua likes this.
      1
  9. nhatkymua

    nhatkymua New Member

    #81 nhatkymua, Feb 24, 2017
    Last edited: Feb 24, 2017
    Mình làm dc rôi
    phải add bucket policy trên s3 để tất cả các file tự upload cho public
    mà có cách nào cho thư mục internal_data lên s3 luôn khoog bạn.
    mình có mua
    [bd] Attachment Store nhưng mình không thích nó upload kiểu thư mục riêng lẽ như vậy. có các nào upload luôn internal_data được không. Thanks bạn
     
    1. xfrocks

      xfrocks XenForo rocks!
      Staff Member

      xfrocks @nhatkymua Nếu ACL đã để public thì không cần bucket policy nữa. Không rõ từ trước bucket của bạn có để policy gì không?
      Về internal_data, không thể upload hết thư mục này vì chủ yếu đó là temp và cần truy xuất nhanh + xóa ngay. Nếu bạn xài [bd] Attachment Store bạn có thể dùng external_data mode, file sẽ được đưa qua [bd] Data Storage để upload.
       
  10. nhatkymua

    nhatkymua New Member

    thanks để mình thử lại. với lại cái Attachment của mình trên 40gb. Chạy rebuild attachment data được chút xíu là ngưng. không lên được s3. Phải có chức năng giống bên [bd] Data Storage. Tự mình upload thư mục attachment lên s3. Xong rồi kết nối xenforo qua s3.
     
    1. xfrocks

      xfrocks XenForo rocks!
      Staff Member

      xfrocks @nhatkymua Bạn có thể chuyển qua external data, chạy move tool như vậy sẽ nhanh. Sau đó dùng tool ngoài upload lên S3. Xong xuôi thì dùng storage options tool để cập nhật lại là được.
       
    2. nhatkymua

      nhatkymua New Member

      nhatkymua @xfrocks Mình có pm inbox bạn, bạn xem giúp với
       
  11. xfrocks

    xfrocks XenForo rocks!
    Staff Member

    xfrocks updated [bd] Data Storage with a new update entry:

    Minor Update

    Read the rest of this update entry...
     
    pete likes this.
  12. xfrocks

    xfrocks XenForo rocks!
    Staff Member

    For owners of this add-on who plan to upgrade to XenForo 2. You can configure XenForo to use FTP-server as external data file storage with these lines in config.php:

    PHP:
    $config['fsAdapters']['data'] = function () {
        return new \
    League\Flysystem\Adapter\Ftp([
            
    'host' => 'ftp.domain.com',
            
    'username' => 'username',
            
    'password' => 'password',
            
    'passive' => false,
            
    'root' => '/domains/ftp.domain.com/public_html/data',
        ]);
    };
    $config['externalDataUrl'] = 'http://ftp.domain.com/data';
     
  13. Whissi

    Whissi New Member

    FYI, with latest update (1.2.5) I am getting
    Code:
    ErrorException: Fatal Error: Call to a member function getStatus() on boolean - library\bdDataStorage\StreamWrapper\S3.php:97
    errors when I try to "Upload a file" in a posting.

    Looks like you have changed bdDataStorage_StreamWrapper_S3::_downloadFile() ins this version. This functions seems to check if there's already such a file. For new files, you will get a 404 and therefore $response is FALSE. In previous versions you checked the return value... adding back such a check, i.e.
    PHP:
    if ($response !== false && $response->getStatus() === 200) {
    fixes the problem for me.
     
    1. xfrocks

      xfrocks XenForo rocks!
      Staff Member

      xfrocks @Whissi That was indeed a nasty bug and your fix is spot on. I have just released v1.2.5b with the fix. Thank you very much.
       
  14. Solari

    Solari Webmaster

    For those of us using FTP, can we have it point to the existing data directory on the webserver without needing to make a copy? The reason we want to use FTP is because our sites are on a load balancer so by using your add-on with remote FTP we can make sure our primary webserver is used (and replicated from to other servers).

    Would this also apply to your attachment store add-on?

    Thanks,
    Ray
     
    1. xfrocks

      xfrocks XenForo rocks!
      Staff Member

      xfrocks @Solari Yes, we don't check for file existence. Just make sure all your files are there.
       
  15. Solari

    Solari Webmaster

    #92 Solari, Mar 24, 2018
    Last edited: Mar 24, 2018
    Gotcha, thanks.

    Silly question, I know --- how do I copy my existing data folder over to S3 per your instructions before using this add-on? Do I also need to create a /data folder on S3?

    Regarding data folder, I already use bd-attachments on S3, so do I assume I don't need to copy the /data/attachments over to S3 again?

    Also, what about the other folders inside /data like /bdCache? It's huge and I'd rather not have to copy that one over. Does this add-on only deal with avatars? If so, I'd just upload data/avatars?

    Appreciate any insight.

    Many thanks,
    Ray
     
    1. xfrocks

      xfrocks XenForo rocks!
      Staff Member

      xfrocks @Solari I have just replied to your message on xenforo.com, sorry for the late reply here.

      You can use the tool you are most familiar with, it doesn't matter. We often use the aws cli. And you need to upload everything inside data into the S3 bucket root. e.g. data/avatar goes to s3://bucket-name/avatar.
       
  16. Solari

    Solari Webmaster

    @xfrocks can you chime in on the above when you get a chance? Thanks.
     
  17. Solari

    Solari Webmaster

    @xfrocks We really need to resolve this, esp. about other folders like bdCache inside /data which we wouldn't want in the cloud. Please see above. Thanks.

    Ray
     
  18. alfa1

    alfa1 Webmaster

    What config should I use for DigitalOcean Spaces?

    Will this work with the https proxy you added to bd attachment store?
    Code:
    $config['bdAttachmentStore_useUntrustedClient'] = true;
     
    1. xfrocks

      xfrocks XenForo rocks!
      Staff Member

      xfrocks @alfa1 No, that won't work :oops:
       
Loading...