Comments (1)
I think this is a bug in pytables::_set_tz()
, where the unit is hard-coded as ns. I submitted a PR which will hopefully resolve this issue.
Just for reference, here is a trace stack I used for debugging the reproducible code:
**** This doesn't work
Calling _read_group()
type of Storer: <class 'pandas.io.pytables.FrameFixed'>
Calling BlockManagerFixed.read()
Calling GenericFixed.read_array()
Checking dtype in read_array(): datetime64[s]
Checking value read from node: [[ 978307200]
[1012608000]] # It is correct so far.
Checking value after reconstructing time zone: <DatetimeArray>
[
['1970-01-01 00:00:00.978307200'],
['1970-01-01 00:00:01.012608']
]
Shape: (2, 1), dtype: datetime64[ns] # So the time zone attribution messed it up somehow.
block0_values <DatetimeArray>
[
['1970-01-01 00:00:00.978307200', '1970-01-01 00:00:01.012608']
]
Shape: (1, 2), dtype: datetime64[ns]
columns Index([0], dtype='int64')
###### result: 0
0 1970-01-01 00:00:00.978307200
1 1970-01-01 00:00:01.012608000
**** However this does work
Calling _read_group()
type of Storer: <class 'pandas.io.pytables.FrameFixed'>
Calling BlockManagerFixed.read()
Calling GenericFixed.read_array()
Checking dtype in read_array(): datetime64[ns]
Checking value read from node: [[ 978307200000000000]
[1012608000000000000]]
Checking value after reconstructing time zone: <DatetimeArray>
[
['2001-01-01 00:00:00'],
['2002-02-02 00:00:00']
]
Shape: (2, 1), dtype: datetime64[ns]
block0_values <DatetimeArray>
[
['2001-01-01 00:00:00', '2002-02-02 00:00:00']
]
Shape: (1, 2), dtype: datetime64[ns]
columns Index([0], dtype='int64')
###### result: 0
0 2001-01-01
1 2002-02-02
from pandas.
Related Issues (20)
- BUG: Parameter converters when using the read function. HOT 2
- BUG: read_parquet wrongly returns empty index if asked to read empty column list HOT 2
- ENH/BUG: pd.date_range() still defaults to nanosecond resolution HOT 1
- ENH: New Name for "numpy_nullable" dtype_backend HOT 1
- BUG: `DatetimeIndex.union` gives wrong result with "datetime64[us]"
- BUILD: Pandas 1.2.5 build no longer works HOT 13
- ENH: .isin() method should use __contains__ rather than __iter__ for user-defined classes to determine presence. HOT 4
- BUG: `pd.read_excel` gives uninformative error for protected files HOT 2
- BUG: eval fails to process expression when one column name starts with a digit or some special characters HOT 1
- BUG: pandas dataframe column definition or mapping does not cater for upper case values. HOT 1
- BUG: HOT 2
- BUG: Limit param of fillna method does not work for pd.Int64Dtype() HOT 2
- BUG: Failed to import pandas <2.1.0 witn numpy >=2.0.0 HOT 3
- BUG: `Series.clip` does not work with scalar numpy arrays. HOT 4
- BUG: `DataFrame.to_numpy()` unnecessarily upcasts to `object` dtype. HOT 1
- ENH: Python 3.13 free-threading support HOT 3
- BUG: Pandas does not validate some parameters properly when reading CSVs and it causes segmentation faults
- BUG:
- BUG: `DataFrame.eval` fails with TypeError with multiline expr but works when `eval` line by line
- BUG: `DataFrame.sparse.from_spmatrix` hard codes an invalid ``fill_value`` for certain subtypes
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pandas.