Installation fails for Python 3 #9

robagar · 2014-09-03T10:39:47Z

Both pip-3.4 install protobuf and manual installation with python3 setup.py build fail with an invalid syntax exception in ez_setup.py.

Tested 2.6.0 using Python 3.4 on Ubuntu 14.04.

Stack trace from the failed manual installation:

rob@rob-pc:~/lib/protobuf/python$ python3 setup.py build
Traceback (most recent call last):
  File "setup.py", line 199, in <module>
    "Protocol Buffers are Google's data interchange format.",
  File "/usr/lib/python3.4/distutils/core.py", line 108, in setup
    _setup_distribution = dist = klass(attrs)
  File "/usr/local/lib/python3.4/dist-packages/setuptools/dist.py", line 262, in __init__
    self.fetch_build_eggs(attrs['setup_requires'])
  File "/usr/local/lib/python3.4/dist-packages/setuptools/dist.py", line 287, in fetch_build_eggs
    replace_conflicting=True,
  File "/usr/local/lib/python3.4/dist-packages/pkg_resources.py", line 631, in resolve
    dist = best[req.key] = env.best_match(req, ws, installer)
  File "/usr/local/lib/python3.4/dist-packages/pkg_resources.py", line 874, in best_match
    return self.obtain(req, installer)
  File "/usr/local/lib/python3.4/dist-packages/pkg_resources.py", line 886, in obtain
    return installer(requirement)
  File "/usr/local/lib/python3.4/dist-packages/setuptools/dist.py", line 338, in fetch_build_egg
    return cmd.easy_install(req)
  File "/usr/local/lib/python3.4/dist-packages/setuptools/command/easy_install.py", line 613, in easy_install
    return self.install_item(spec, dist.location, tmpdir, deps)
  File "/usr/local/lib/python3.4/dist-packages/setuptools/command/easy_install.py", line 643, in install_item
    dists = self.install_eggs(spec, download, tmpdir)
  File "/usr/local/lib/python3.4/dist-packages/setuptools/command/easy_install.py", line 833, in install_eggs
    return self.build_and_install(setup_script, setup_base)
  File "/usr/local/lib/python3.4/dist-packages/setuptools/command/easy_install.py", line 1055, in build_and_install
    self.run_setup(setup_script, setup_base, args)
  File "/usr/local/lib/python3.4/dist-packages/setuptools/command/easy_install.py", line 1040, in run_setup
    run_setup(setup_script, args)
  File "/usr/local/lib/python3.4/dist-packages/setuptools/sandbox.py", line 68, in run_setup
    DirectorySandbox(setup_dir).run(runner)
  File "/usr/local/lib/python3.4/dist-packages/setuptools/sandbox.py", line 114, in run
    return func()
  File "/usr/local/lib/python3.4/dist-packages/setuptools/sandbox.py", line 67, in runner
    _execfile(setup_script, ns)
  File "/usr/local/lib/python3.4/dist-packages/setuptools/sandbox.py", line 43, in _execfile
    exec(code, globals, locals)
  File "/tmp/easy_install-thdmg8q1/google-apputils-0.4.0/setup.py", line 18, in <module>
    sys.stderr.write(
  File "/tmp/easy_install-thdmg8q1/google-apputils-0.4.0/ez_setup.py", line 79
    except pkg_resources.VersionConflict, e:
                                        ^
SyntaxError: invalid syntax

The text was updated successfully, but these errors were encountered:

gpshead · 2014-09-03T19:26:35Z

See my comment on #7 with details for what remains to be done for this to work out of the box under Python 3. The setup code hasn't been updated for python 3 yet; the listed files in that issue need running through 2to3 as part of the process.

virtuald · 2014-11-30T17:48:18Z

I installed the current trunk on OSX with python 3.4.2, and everything works fine.

virtuald · 2014-12-09T05:33:44Z

I can also confirm Fedora 21 works.

virtuald · 2014-12-17T17:47:58Z

This bug should be closed, was fixed via #50

bearrito · 2015-01-12T02:56:49Z

Not working for me on 3.4 in a virtualenv running on Centos 6.6

pip3.4 install protobuf
Collecting protobuf
Using cached protobuf-2.6.1.tar.gz
/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/pkg_resources.py:2443: PEP440Warning: 'google (apputils-0.2)' is being parsed as a legacy, non PEP 440, version. You may find odd behavior and sort order. In particular it will be sorted as less than 0.0. It is recommend to migrate to PEP 440 compatible versions.
PEP440Warning,
/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/pkg_resources.py:2443: PEP440Warning: 'google (apputils-0.3.0)' is being parsed as a legacy, non PEP 440, version. You may find odd behavior and sort order. In particular it will be sorted as less than 0.0. It is recommend to migrate to PEP 440 compatible versions.
PEP440Warning,
/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/pkg_resources.py:2443: PEP440Warning: 'google (apputils-0.4.0)' is being parsed as a legacy, non PEP 440, version. You may find odd behavior and sort order. In particular it will be sorted as less than 0.0. It is recommend to migrate to PEP 440 compatible versions.
PEP440Warning,
/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/pkg_resources.py:2443: PEP440Warning: 'google (apputils-0.4.1)' is being parsed as a legacy, non PEP 440, version. You may find odd behavior and sort order. In particular it will be sorted as less than 0.0. It is recommend to migrate to PEP 440 compatible versions.
PEP440Warning,
/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/pkg_resources.py:2443: PEP440Warning: 'google (apputils-0.1)' is being parsed as a legacy, non PEP 440, version. You may find odd behavior and sort order. In particular it will be sorted as less than 0.0. It is recommend to migrate to PEP 440 compatible versions.
PEP440Warning,
Traceback (most recent call last):
File "", line 20, in
File "/tmp/pip-build-1_vgzphc/protobuf/setup.py", line 200, in
"Protocol Buffers are Google's data interchange format.",
File "/usr/local/lib/python3.4/distutils/core.py", line 108, in setup
_setup_distribution = dist = klass(attrs)
File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/setuptools/dist.py", line 271, in init
self.fetch_build_eggs(attrs['setup_requires'])
File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/setuptools/dist.py", line 317, in fetch_build_eggs
replace_conflicting=True,
File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/pkg_resources.py", line 747, in resolve
dist = best[req.key] = env.best_match(req, ws, installer)
File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/pkg_resources.py", line 999, in best_match
return self.obtain(req, installer)
File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/pkg_resources.py", line 1011, in obtain
return installer(requirement)
File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/setuptools/dist.py", line 384, in fetch_build_egg
return cmd.easy_install(req)
File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/setuptools/command/easy_install.py", line 618, in easy_install
return self.install_item(spec, dist.location, tmpdir, deps)
File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/setuptools/command/easy_install.py", line 648, in install_item
dists = self.install_eggs(spec, download, tmpdir)
File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/setuptools/command/easy_install.py", line 838, in install_eggs
return self.build_and_install(setup_script, setup_base)
File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/setuptools/command/easy_install.py", line 1060, in build_and_install
self.run_setup(setup_script, setup_base, args)
File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/setuptools/command/easy_install.py", line 1045, in run_setup
run_setup(setup_script, args)
File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/setuptools/sandbox.py", line 68, in run_setup
DirectorySandbox(setup_dir).run(runner)
File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/setuptools/sandbox.py", line 114, in run
return func()
File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/setuptools/sandbox.py", line 67, in runner
_execfile(setup_script, ns)
File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/setuptools/sandbox.py", line 43, in _execfile
exec(code, globals, locals)
File "/tmp/easy_install-fpw5bl33/google-apputils-0.4.1/setup.py", line 18, in
sys.stderr.write
Complete output from command python setup.py egg_info:
/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/pkg_resources.py:2443: PEP440Warning: 'google (apputils-0.2)' is being parsed as a legacy, non PEP 440, version. You may find odd behavior and sort order. In particular it will be sorted as less than 0.0. It is recommend to migrate to PEP 440 compatible versions.

  PEP440Warning,

/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/pkg_resources.py:2443: PEP440Warning: 'google (apputils-0.3.0)' is being parsed as a legacy, non PEP 440, version. You may find odd behavior and sort order. In particular it will be sorted as less than 0.0. It is recommend to migrate to PEP 440 compatible versions.

  PEP440Warning,

/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/pkg_resources.py:2443: PEP440Warning: 'google (apputils-0.4.0)' is being parsed as a legacy, non PEP 440, version. You may find odd behavior and sort order. In particular it will be sorted as less than 0.0. It is recommend to migrate to PEP 440 compatible versions.

  PEP440Warning,

/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/pkg_resources.py:2443: PEP440Warning: 'google (apputils-0.4.1)' is being parsed as a legacy, non PEP 440, version. You may find odd behavior and sort order. In particular it will be sorted as less than 0.0. It is recommend to migrate to PEP 440 compatible versions.

  PEP440Warning,

/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/pkg_resources.py:2443: PEP440Warning: 'google (apputils-0.1)' is being parsed as a legacy, non PEP 440, version. You may find odd behavior and sort order. In particular it will be sorted as less than 0.0. It is recommend to migrate to PEP 440 compatible versions.

  PEP440Warning,

Traceback (most recent call last):

  File "<string>", line 20, in <module>

  File "/tmp/pip-build-1_vgzphc/protobuf/setup.py", line 200, in <module>

    "Protocol Buffers are Google's data interchange format.",

  File "/usr/local/lib/python3.4/distutils/core.py", line 108, in setup

    _setup_distribution = dist = klass(attrs)

  File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/setuptools/dist.py", line 271, in __init__

    self.fetch_build_eggs(attrs['setup_requires'])

  File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/setuptools/dist.py", line 317, in fetch_build_eggs

    replace_conflicting=True,

  File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/pkg_resources.py", line 747, in resolve

    dist = best[req.key] = env.best_match(req, ws, installer)

  File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/pkg_resources.py", line 999, in best_match

    return self.obtain(req, installer)

  File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/pkg_resources.py", line 1011, in obtain

    return installer(requirement)

  File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/setuptools/dist.py", line 384, in fetch_build_egg

    return cmd.easy_install(req)

  File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/setuptools/command/easy_install.py", line 618, in easy_install

    return self.install_item(spec, dist.location, tmpdir, deps)

  File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/setuptools/command/easy_install.py", line 648, in install_item

    dists = self.install_eggs(spec, download, tmpdir)

  File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/setuptools/command/easy_install.py", line 838, in install_eggs

    return self.build_and_install(setup_script, setup_base)

  File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/setuptools/command/easy_install.py", line 1060, in build_and_install

    self.run_setup(setup_script, setup_base, args)

  File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/setuptools/command/easy_install.py", line 1045, in run_setup

    run_setup(setup_script, args)

  File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/setuptools/sandbox.py", line 68, in run_setup

    DirectorySandbox(setup_dir).run(runner)

  File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/setuptools/sandbox.py", line 114, in run

    return func()

  File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/setuptools/sandbox.py", line 67, in runner

    _execfile(setup_script, ns)

  File "/home/bearrito/.virtualenvs/sketchy/lib/python3.4/site-packages/setuptools/sandbox.py", line 43, in _execfile

    exec(code, globals, locals)

  File "/tmp/easy_install-fpw5bl33/google-apputils-0.4.1/setup.py", line 18, in <module>

    sys.stderr.write

----------------------------------------

virtuald · 2015-01-12T03:51:34Z

@bearrito , 2.6.1 does not work. You need to install the 3.0.0 alpha (specify the --pre flag to pip to get it).

gregsskyles · 2015-08-02T20:53:13Z

I downloaded 3.0.0-alpha-3 cpp and python, built protoc and python, then 'python setup.py test' dies when it gets to this line from the supplied file google/protobuf/internal/decoder.py:
except UnicodeDecodeError, e:
with the clearly Python 2 syntax...are we supposed to use python 2 to build the python 3 compatible version?

…ory_fixup2 fixup2: add System.Memory dependency

Added msgdef flag to indicate map_entry protos.

Provide UT that reproduces issue protocolbuffers#7

==500166==WARNING: MemorySanitizer: use-of-uninitialized-value #0 0xdd383e in google::protobuf::compiler::DiskSourceTree::OpenDiskFile(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) build_msan/./contrib/protobuf/src/google/protobuf/compiler/importer.cc:504:7 #1 0xdd1eb2 in google::protobuf::compiler::DiskSourceTree::DiskFileToVirtualFile(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >*, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >*) build_msan/./contrib/protobuf/src/google/protobuf/compiler/importer.cc:431:51 #2 0x540619 in google::protobuf::compiler::CommandLineInterface::MakeProtoProtoPathRelative(google::protobuf::compiler::DiskSourceTree*, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >*, google::protobuf::DescriptorDatabase*) build_msan/./contrib/protobuf/src/google/protobuf/compiler/command_line_interface.cc:1362:24 #3 0x5314fb in google::protobuf::compiler::CommandLineInterface::MakeInputsBeProtoPathRelative(google::protobuf::compiler::DiskSourceTree*, google::protobuf::DescriptorDatabase*) build_msan/./contrib/protobuf/src/google/protobuf/compiler/command_line_interface.cc:1415:10 #4 0x5314fb in google::protobuf::compiler::CommandLineInterface::InitializeDiskSourceTree(google::protobuf::compiler::DiskSourceTree*, google::protobuf::DescriptorDatabase*) build_msan/./contrib/protobuf/src/google/protobuf/compiler/command_line_interface.cc:1168:8 #5 0x52541f in google::protobuf::compiler::CommandLineInterface::Run(int, char const* const*) build_msan/./contrib/protobuf/src/google/protobuf/compiler/command_line_interface.cc:1026:10 #6 0x50f5d6 in google::protobuf::compiler::ProtobufMain(int, char**) build_msan/./contrib/protobuf/src/google/protobuf/compiler/main.cc:104:14 protocolbuffers#7 0x50fe58 in main build_msan/./contrib/protobuf/src/google/protobuf/compiler/main.cc:112:10 protocolbuffers#8 0x7f817143db24 in __libc_start_main (/usr/lib/libc.so.6+0x27b24) protocolbuffers#9 0x48904d in _start (/mnt/ch/ClickHouse/build_msan/contrib/protobuf-cmake/protoc+0x48904d) Uninitialized value was created by an allocation of 'sb' in the stack frame of function '_ZN6google8protobuf8compiler14DiskSourceTree12OpenDiskFileERKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE' #0 0xdd3320 in google::protobuf::compiler::DiskSourceTree::OpenDiskFile(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) build_msan/./contrib/protobuf/src/google/protobuf/compiler/importer.cc:492 SUMMARY: MemorySanitizer: use-of-uninitialized-value build_msan/./contrib/protobuf/src/google/protobuf/compiler/importer.cc:504:7 in google::protobuf::compiler::DiskSourceTree::OpenDiskFile(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) Exiting

xfxyjwf added this to the Python 3 support milestone Sep 3, 2014

wouterdebie mentioned this issue Sep 12, 2014

python 3 support? spotify/snakebite#62

Open

dhermes mentioned this issue Nov 13, 2014

Ensure Python 3 support googleapis/google-cloud-python#91

Closed

cloudkey mentioned this issue Feb 4, 2015

FileDescriptorTables *** glibc detected *** double free or corruption (out) #194

Closed

inferrna mentioned this issue Oct 6, 2015

Python3 support BVLC/caffe#293

Closed

xfxyjwf added the obsolete label Dec 22, 2015

xfxyjwf closed this as completed Dec 22, 2015

roczpwu mentioned this issue Jul 21, 2017

protobuf-3.3.2 segment fault: 11 #3402

Closed

FZUPotato mentioned this issue Aug 21, 2017

coredump under the MIPS64 architecture #3532

Closed

jakiechris mentioned this issue Nov 20, 2017

[solved, pls close this issue] protobuf crashes on android 4.4.2 on Huawei p7 #3922

Closed

E-HERO mentioned this issue Dec 3, 2017

proto used by executable file and shared lib crash #3991

Closed

ujmedia mentioned this issue Jul 23, 2018

terminate called after throwing an instance of 'std::system_error' - after switching to version 3.6.0 (from 3.5.1) #4958

Closed

mkosieradzki pushed a commit to mkosieradzki/protobuf that referenced this issue Aug 9, 2018

Merge pull request protocolbuffers#9 from jtattermusch/add_system_mem…

bf0dd86

…ory_fixup2 fixup2: add System.Memory dependency

catskul mentioned this issue Aug 21, 2018

Problems with Python Layer: Protobuf Internal Error - Mutex Lock #3671

Closed

TeBoring pushed a commit to TeBoring/protobuf that referenced this issue Jan 19, 2019

Merge pull request protocolbuffers#9 from cfallin/map-fields

0ab8d5e

Added msgdef flag to indicate map_entry protos.

arnow117 mentioned this issue Apr 1, 2019

python: SIGSEGV when use PyImport_Import import symbol_database #5979

Closed

sunbibei mentioned this issue Sep 26, 2019

-m32 is not compatible with -freg-struct-return #6700

Closed

PierrickVoulet pushed a commit to PierrickVoulet/protobuf that referenced this issue May 30, 2020

Merge pull request protocolbuffers#9 from PierrickVoulet/testIssue7

1dfbff7

Provide UT that reproduces issue protocolbuffers#7

snehasinha13 mentioned this issue Sep 30, 2020

Weird SIGSEGV in protobuf import #7931

Closed

xianggao mentioned this issue Oct 27, 2021

core dump initializing at google::protobuf::internal::EpsCopyInputStream::ReadString #9163

Closed

saai63 mentioned this issue Dec 7, 2021

MessageToJsonString() always seems to crash when linked statically to protobuf #9286

Closed

sin-zx mentioned this issue Jan 18, 2022

coredump when calls MessageToJsonString() #9417

Closed

blacktek mentioned this issue Jun 7, 2022

segfault with both php 7.4 and php 8.1 in _zend_is_inconsistent (ht=0x0, file=0x5616496c7238 #10113

Closed

blacktek mentioned this issue Sep 22, 2022

Protobuf PHP compiled library segmentation faults googleads/google-ads-php#845

Closed

rong-lai mentioned this issue Jul 25, 2023

Occasional coredump occurred when using ParseFromString #13387

Closed

rschu1ze mentioned this issue Oct 24, 2023

Silence MSAN warning when running protoc ClickHouse/google-protobuf#3

Closed

babuveld mentioned this issue Jan 12, 2024

route_guide_server process core seen during string encode in linux 32bit #15418

Closed

M-Labedzki mentioned this issue May 23, 2024

Invalid symbol name: google.protobuf.@ #16940

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Installation fails for Python 3 #9

Installation fails for Python 3 #9

robagar commented Sep 3, 2014

gpshead commented Sep 3, 2014

Uh oh!

virtuald commented Nov 30, 2014

Uh oh!

virtuald commented Dec 9, 2014

Uh oh!

virtuald commented Dec 17, 2014

Uh oh!

bearrito commented Jan 12, 2015

Uh oh!

virtuald commented Jan 12, 2015

Uh oh!

gregsskyles commented Aug 2, 2015

Uh oh!

Installation fails for Python 3 #9

Installation fails for Python 3 #9

Comments

robagar commented Sep 3, 2014

gpshead commented Sep 3, 2014

Uh oh!

virtuald commented Nov 30, 2014

Uh oh!

virtuald commented Dec 9, 2014

Uh oh!

virtuald commented Dec 17, 2014

Uh oh!

bearrito commented Jan 12, 2015

Uh oh!

virtuald commented Jan 12, 2015

Uh oh!

gregsskyles commented Aug 2, 2015

Uh oh!