Bumping up min version for pyarrow

[anjsudh]

closes #18742
closes #23409

• tests passed
• passes git diff upstream/master -u -- "*.py" | flake8 --diff
• whatsnew entry

[pep8speaks]

Hello @anjsudh! Thanks for submitting the PR.

• There are no PEP8 issues in the file pandas/io/parquet.py !

• There are no PEP8 issues in the file pandas/tests/io/test_parquet.py !

[jreback]

linting issues run: LINT=1 ci/code_checks.sh locally to see.

also can you put a check on fastparquet < 0.1 (or could do 0.1.2) i think is ok too

[jreback]

@martindurant what is the oldest fastparquet that we should target here?

[datapythonista]

Can you run scripts/convert_deps.py, so ci/requirements-optional-pip.txt is updated.

[martindurant]

Since this is for newer pandas, and fastparquet is pretty light on specific versions of its dependencies, I would keep with the most recent, 0.1.6, which is now 2.5 months old. I ought to put out a new version but wouldn't ask you to depend on it.

[jreback]

@martindurant well, this version of pandas could easily be installed on an existing setup, so easier to allow an older version unless we really need to upgrade it. ok let's go with 0.1.2 then.

[martindurant]

0.1.2 is over a year old. OK, if the tests still pass...

My point was, if someone was wanting to upgrade their pandas, it should be reasonable for them to upgrade fastparquet too.

[jreback]

there is no easy way to force an upgrade as fp is just one of many optional dependencies

so much easier to have backward compatibility rather than annoy users

[codecov]

Codecov Report

Merging #23482 into master will increase coverage by 0.02%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##           master   #23482      +/-   ##
==========================================
+ Coverage   92.23%   92.25%   +0.02%     
==========================================
  Files         161      161              
  Lines       51197    51176      -21     
==========================================
- Hits        47220    47214       -6     
+ Misses       3977     3962      -15

Flag	Coverage Δ
#multiple	90.64% <100%> (+0.02%)	⬆️
#single	42.28% <14.28%> (+0.01%)	⬆️

Impacted Files	Coverage Δ
pandas/io/parquet.py	83.5% <100%> (+9.77%)	⬆️

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 64c3491...91147aa. Read the comment docs.

[anjsudh]

so shall i go ahead with fastparquet 0.1.2 as minimum version?

[anjsudh]

have set min version for fastparquet as 0.1.2.

[jreback]

you have a lint error

inting .py code
./pandas/io/parquet.py:8:1: F401 'pandas.Int64Index' imported but unused
./pandas/io/parquet.py:8:1: F401 'pandas.RangeIndex' imported but unused

ping on green.

[TomAugspurger]

Thanks!