Comments (7)
can I take this issue ?
from pandas.
take
from pandas.
@sunghjung3 I think it seems to be a regression in recent versions of pandas. It appears that a 1-dimensional numpy array with a single entry is being automatically converted to a 0-dimensional array when stored in a DataFrame.
Temporary Workaround:
- Until the issue is resolved in future pandas releases, you can explicitly check and reshape the arrays as needed.
import pandas as pd
import numpy as np
df = pd.DataFrame(columns=['x'])
arr0 = np.array([1., 2.])
df.loc[0, "x"] = arr0
print(df.loc[0, "x"].shape) # prints (2,)
arr1 = np.array([1.])
df.loc[1, "x"] = arr1 if arr1.shape != () else arr1.reshape(1,)
print(df.loc[1, "x"].shape) # prints (1,)
Hope this helps,
Thanks
from pandas.
@Siddharth-Latthe-07 I've already tried this, and it doesn't work. It still prints ()
. Please try it yourself.
from pandas.
oh, I see then can we create a custom function to ensure that the shape of the numpy array is preserved when you store it in the DataFrame. This function will explicitly check the shape of the array and reshape it if necessary before storing it in the DataFrame.
Thoughts ? @sunghjung3
from pandas.
something like this:-
def safe_loc_assign(df, index, column, value):
if isinstance(value, np.ndarray) and value.shape == ():
value = value.reshape(1,)
df.at[index, column] = value
from pandas.
@Siddharth-Latthe-07 I don't get the logic of your function.
I'm assuming that we would call this function like safe_loc_assign(df, 1, "x", arr1)
. And inside this function, it checks for value.shape == ()
. But the shape of the value
argument (which is arr1
) is not ()
, so this if statement isn't even utilized.
And the result is still the same; it prints ()
.
Also, even if I change this if-statement to value.shape == (1,)
, it still doesn't work.
from pandas.
Related Issues (20)
- BUG: OverflowError: value too large to convert to int when manipulating very large dataframes HOT 6
- DOC: Wrong bug number in what's new v3.0.0 HOT 3
- ENH: Checking gaps for time series HOT 2
- ENH: Support non-categorical values for pandas bar plots when x axis is datetime values HOT 2
- ENH: In pandas.testing.assert_frame_equal, support per-column configuration HOT 5
- DOC: read_csv: date_format HOT 2
- ENH: Breakpoint method for dataframes HOT 1
- BUG: inconsistency when `read_csv` reads MultiIndex with empty values HOT 1
- BUG: .str.contains `na` validation HOT 4
- ENH: Option to configure line wrapping for columns HOT 4
- BUG: inconsistent indices in `GroupByRolling` when selecting or not selecting subset of columns HOT 1
- BUG: provide better error message for pd.Timedelta - pd.Series[Timestamp] HOT 4
- BUG: Wrong result of Kurtosis HOT 2
- BUG: StringDtype conversion to bool changes False to True HOT 3
- Development with Visual Studio Tools 2022 not possible? HOT 3
- ERR: consistent error messages for unsupported reduction operations
- ENH: `DataFrame.struct.explode(column, *, separator=".")` method to pull struct subfields into the parent DataFrame HOT 2
- BUG: `to_markdown` raises `ValueError` when values are `np.array`s with more than one element HOT 3
- DOC: fix docstring validation errors for pandas.Series HOT 18
- ENH: Drop list menu lost when reading xlsx files from pandas HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pandas.