libcloud-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <>
Subject [jira] [Commented] (LIBCLOUD-725) Binary data storage in LocalStorageDriver fails on Py3
Date Fri, 28 Aug 2015 10:41:45 GMT


ASF GitHub Bot commented on LIBCLOUD-725:

GitHub user torfuspolymorphus opened a pull request:

    [LIBCLOUD-725] Fix handling of binary data in LocalStorageDriver on Py3.

    This PR fixes issue [LIBCLOUD-725](
`` has problems with binary data on Python
    The fix is to make sure that files are opened in binary mode for reading and writing.
    Tests and documentation have been updated.

You can merge this pull request into a Git repository by running:

    $ git pull issue725

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #568
commit cfd7469518072bc59917730267256df78d709d37
Author: Torf <>
Date:   2015-08-28T10:36:19Z

    [LIBCLOUD-725] Fix handling of binary data in LocalStorageDriver on Py3.


> Binary data storage in LocalStorageDriver fails on Py3
> ------------------------------------------------------
>                 Key: LIBCLOUD-725
>                 URL:
>             Project: Libcloud
>          Issue Type: Bug
>          Components: Storage
>         Environment: LibCloud 0.17.0, Python 3.4
>            Reporter: torf
> {{LocalStorageDriver.upload_object_via_stream}} does not allow the upload of bytes in
Python 3, despite the fact that {{download_object_as_stream}} returns a stream of bytes:
> {code}
> >>> container.upload_object_via_stream(io.BytesIO(b'foobar'), 'key')
> Traceback (most recent call last):
>   File "<stdin>", line 1, in <module>
>   File
> "/home/torf/projects/coba/venv/lib/python3.4/site-packages/libcloud/storage/",
> line 157, in upload_object_via_stream
>     iterator, self, object_name, extra=extra, **kwargs)
>   File
> "/home/torf/projects/coba/venv/lib/python3.4/site-packages/libcloud/storage/drivers/",
> line 497, in upload_object_via_stream
>     obj_file.close()
>   File
> "/home/torf/projects/coba/venv/lib/python3.4/site-packages/libcloud/storage/drivers/",
> line 69, in __exit__
>     raise value
>   File
> "/home/torf/projects/coba/venv/lib/python3.4/site-packages/libcloud/storage/drivers/",
> line 495, in upload_object_via_stream
>     obj_file.write(data)
> TypeError: must be str, not bytes
> {code}
> The problem is that {{LocalStorageDriver}} opens the target file for writing in text
mode ({{'w'}}) instead of binary mode ({{'wb'}}).
> As discussed on the users mailing list I am working on a pull request for this issue.

This message was sent by Atlassian JIRA

View raw message