set_option('max_colwidth', N) not working on groupby output

[brifordwylie]

Hi All,

Might be pilot error (or the incorrect expectations), but I was expecting the max_colwidth option to work on groupby terminal output. Replication here:

$ python
> import pandas as pd
> df = pd.DataFrame([{'a':'foo','b':'bar','c':'uncomfortably long line with lots of stuff','d':1},  \
                                   {'a':'foo','b':'bar','c':'stuff', 'd':1}])
> df
     a    b                                           c  d
0  foo  bar  uncomfortably long line with lots of stuff  1
1  foo  bar                                       stuff  1

> pd.set_option('max_colwidth', 20)
> df
     a    b                    c  d
0  foo  bar  uncomfortably lo...  1
1  foo  bar                stuff  1

> group_df = df.groupby(['a','b','c']).sum()
> group_df
                                                    d
a   b   c                                            
foo bar stuff                                       1
        uncomfortably long line with lots of stuff  1
>>> 

>>> pd.show_versions()

INSTALLED VERSIONS
------------------
commit: None
python: 2.7.6.final.0
python-bits: 64
OS: Darwin
OS-release: 13.3.0
machine: x86_64
processor: i386
byteorder: little
LC_ALL: None
LANG: en_US.UTF-8

pandas: 0.14.1
nose: None
Cython: 0.20.2
numpy: 1.8.1
scipy: None
statsmodels: None
IPython: 2.1.0
sphinx: 1.2.2
patsy: None
scikits.timeseries: None
dateutil: 2.2
pytz: 2014.4
bottleneck: None
tables: None
numexpr: None
matplotlib: None
openpyxl: None
xlrd: None
xlwt: None
xlsxwriter: None
lxml: None
bs4: None
html5lib: None
httplib2: None
apiclient: None
rpy2: None
sqlalchemy: None
pymysql: None
psycopg2: None
>>> 

[jreback]

hmm, seems like a bug. that option is not well tested either, possibly related #7059

want to have a look; add some tests and see whats going on?

[brifordwylie]

Yeah, I'll poke around on this.. it will be a good learning experience for me. :)

[jorisvandenbossche]

after discussion with @tiagoantao: the issue is that the max_colwidth is not applied to the index, only to the columns (so it has nothing really to do with groupby, but because of the groupby, the columns became a multi-index).

display.max_colwidth : int
    The maximum width in characters of a column in the repr of
    a pandas data structure. When the column overflows, a "..."
    placeholder is embedded in the output.
    [default: 50] [currently: 50]

So literally, it is only applied to the columns, but I think it seems logical to also apply this maximum width to the index?

[tiagoantao]

I have designed an embryo of solution for this. I would bet that this is naive, but maybe it suggests a way. It changes the way the index is rendered.
If you give me some directions, I can try to make this less naive:
https://github.com/tiagoantao/pandas/commit/55ed6f0953f2945046f47d1a796251b9bd599cdd

[jreback]

closed by #8954