PyPy3 support

[isuruf]

1. Enable dynamic attribute support for PyPy >=6 from Enable dynamic attribute support for Pypy >= 6 #1494 and added a test
2. Disabled eval_file as in [WIP] Test PyPy 3.6 on travis #1720 (comment)
3. Workaround for __qualname__ on PyPy3
4. Disabled numpy, scipy testing on PyPy as they fail to install.

TODO:

• Add a workaround for https://bitbucket.org/pypy/pypy/issues/2482/cpyext-tp_basicsize-only-considers-first. @jagerman added a workaround in Python multiple inheritance #693, but that seems to work only for PyPy 5.8 and not even PyPy 5.9. See PyPy 5.9.0 segfault under multiple inheritance #1130

• Fix test_stl_caster_vs_stl_bind

cc @mattip, @ax3l

[isuruf]

test_stl_caster_vs_stl_bind issue is because sq_item is not being set even though __getitem__ is set for the type VectorInt.

[isuruf]

Maybe defining __getitem__ doesn't automatically set the value sq_item in PyPy.

[mattip]

Maybe defining __getitem__ doesn't automatically set the value sq_item in PyPy

It should, as long as __getitem__ is set before calling PyType_Ready

[isuruf]

It should, as long as getitem is set before calling PyType_Ready

Ah, thanks. I think __getitem__ gets defined after PyType_Ready is called.

PyType_Ready is called by make_new_python_type which is called by generic_type::initialize method which is called by class_ constructor and the __getitem__ method is added by class_::def method.

Somebody more familiar with pybind11 internals should confirm though.

[inducer]

Slightly off-topic: @isuruf, could you please keep this branch around for a bit? I'm using it here.

[ax3l]

cc @wjakob @jagerman this PR is needs some feedback on its way to add PyPy3.6 support, please.

[isuruf]

ping

[wjakob]

Ok, so what kind of feedback do you require? It's been ages since I looked at PyPy internals, so I don't think I could help much with that. The patch looks reasonable to me, but I suppose it does not fully work yet?

[isuruf]

Thanks @mattip. One more issue to fix #2146 (comment). I'm afraid, you might be the best person to fix that as well.

[isuruf]

If I use the suggestion by @mattip in https://bitbucket.org/pypy/pypy/issues/2482/cpyext-tp_basicsize-only-considers-first, I can get the test to pass, but it segfaults other tests.

https://bitbucket.org/pypy/pypy/commits/8175c5e20480 mentions that

but perhaps we should support PyBaseObject_Type too?

[wjakob]

I'd like to briefly check in about the status of the PR -- are we stalled on landing improvements to PyPy? There are already some good improvements, so one option would be to merge part of the changes and leave the rest pending.

[isuruf]

Yes. I've marked a couple of tests (related to multiple inheritance) as bug_in_pypy until we can fix it in PyPy. (I'm not entirely sure it's a bug in PyPy, but it looks like it and @mattip can confirm)

CI is passing (with two expected failures), so we can merge right now to avoid any regressions in the future and work on fixing the multiple inheritance issue.

[wjakob]

Ok, will do as soon as the PR is merge-able (conflicts).

[isuruf]

This is ready now

[wjakob]

Merged, let's track future improvements in a separate PR.

[YannickJadoul]

Tests are failing on master, for some reason.

[bstaletic]

>       assert msg(exc_info.value) == "m.class_.Pet.__init__() must be called when overriding __init__"
E       assert --- actual / +++ expected
E         - Pet.__init__() must be called when overriding __init__
E         + m.class_.Pet.__init__() must be called when overriding __init__
E         ? +++++++++

So the raised exception looks different than on CPython...

[YannickJadoul]

Something something __qualname__?

[bstaletic]

Should we mess with __qualname__ or instead do something like this:

assert msg(exec_info.value) in [ cpython_error_string, pypy_error_string ]

[YannickJadoul]

Should we mess with __qualname__ or instead do something like this:

assert msg(exec_info.value) in [ cpython_error_string, pypy_error_string ]

Depends a bit on whether this is a PyPy thing, or whether it's a failure of pybind11 to not set tp_name correctly?

[bstaletic]

If I'm reading this right, pybind11, since python 3.3 doesn't touch __qualname__.