Description
import pandas as pd
import numpy as np
from decimal import Decimal
np.random.seed(123)
df = pd.DataFrame(np.random.randint(0,5,size=(5, 4)), columns=list('ABCD'))
df.valuesarray([[2, 4, 2, 1],
[3, 2, 3, 1],
[1, 0, 1, 1],
[0, 0, 1, 3],
[4, 0, 0, 4]])
for col in df.columns:
for row in df.index:
df.at[row, col] = Decimal(str(df.at[row, col]))
df.valuesarray([[2, 4, 2, 1],
[3, 2, 3, 1],
[1, 0, 1, 1],
[0, 0, 1, 3],
[4, 0, 0, 4]])
for col in df.columns:
for row in df.index:
df.loc[row, col] = Decimal(str(df.loc[row, col]))
df.valuesarray([[Decimal('2'), Decimal('4'), Decimal('2'), Decimal('1')],
[Decimal('3'), Decimal('2'), Decimal('3'), Decimal('1')],
[Decimal('1'), Decimal('0'), Decimal('1'), Decimal('1')],
[Decimal('0'), Decimal('0'), Decimal('1'), Decimal('3')],
[Decimal('4'), Decimal('0'), Decimal('0'), Decimal('4')]],
dtype=object)
Problem description
I am using the decimal.Decimal package for financial calculations and to prevent float rounding errors. .astype(Decimal) does not work as it is not a numpy dtype nor a python dtype. So my only option is to loop through a large DataFrame and assign the Decimal dtype. As I am only get/set a single value and modifying it, I was trying to use .at/.iat however when I run this it does not actually change the datatype. However when I run the same loop using the less efficient .loc/.iloc it works. I have no idea why. My expected output is the array of values changed to a Decimal object.
Expected Output
array([[Decimal('2'), Decimal('4'), Decimal('2'), Decimal('1')],
[Decimal('3'), Decimal('2'), Decimal('3'), Decimal('1')],
[Decimal('1'), Decimal('0'), Decimal('1'), Decimal('1')],
[Decimal('0'), Decimal('0'), Decimal('1'), Decimal('3')],
[Decimal('4'), Decimal('0'), Decimal('0'), Decimal('4')]],
dtype=object)
Output of pd.show_versions()
[paste the output of pd.show_versions() here below this line]
INSTALLED VERSIONS
commit: None
python: 3.6.5.final.0
python-bits: 64
OS: Windows
OS-release: 10
machine: AMD64
processor: Intel64 Family 6 Model 142 Stepping 10, GenuineIntel
byteorder: little
LC_ALL: None
LANG: None
LOCALE: None.None
pandas: 0.23.4
pytest: 3.7.1
pip: 18.0
setuptools: 40.2.0
Cython: 0.28.5
numpy: 1.15.0
scipy: 1.1.0
pyarrow: 0.9.0
xarray: None
IPython: 6.5.0
sphinx: 1.7.6
patsy: 0.5.0
dateutil: 2.7.3
pytz: 2018.5
blosc: None
bottleneck: 1.2.1
tables: 3.4.4
numexpr: 2.6.7
feather: 0.4.0
matplotlib: 2.2.3
openpyxl: 2.5.5
xlrd: 1.1.0
xlwt: 1.3.0
xlsxwriter: 1.0.5
lxml: 4.2.4
bs4: 4.6.3
html5lib: 1.0.1
sqlalchemy: 1.2.10
pymysql: None
psycopg2: None
jinja2: 2.10
s3fs: None
fastparquet: None
pandas_gbq: None
pandas_datareader: None