How can i open dataset in matlab which is .pkl format?

I get a dataset in pickle format From a Author,but i want to do my project in matlab. so which command in matlab which help to open and use that datast.

[kc]

Is there any way, i am also gt stuck here.

plz help

Answer 1

[Tim R]

Here's a quick solution based on the links assuming you've set-up Matlab to point to the right Python ver and libraries:

    fid=py.open(filename,'rb');
    data=py.pickle.load(fid);

The contents of data will need to be converted from their respective python classes to those used by Matlab. For example, if data is a list then convert to a cell:

data=cell(data);

Similarly, dictionaries can be converted to strucures

data=struct(data)

And numpy arrays to doubles

data=double(data);

[kc]

Thank you so much for your reply. Unfortunately i dnt know anything about python.

Now i have a text file in which path of that fiile is given where my data is saved (actually this is not my system path i need to save it on that location, somehow i will manage that) . So now in MATLAB i need to extract that file location and eventually read that data. everytime i need to store in some folders.

I have created cell from that text file, so can i read that cell data as a path now ?

[Walter Roberson]

filename = fileread('NameOfFileThatHasPathToDataFile');

fid=py.open(filename,'rb');
data=py.pickle.load(fid);

[kc]

Sir thanks to you too,but this is not working in matlab. and now no need of that pickle file. Only that path file is required,

Thanks :)

[Quan minhquanccna]

Thank you for helping us.

I tried to load a pickle with a trained "XGBoost" model in Python with the same command above. However, I received an error as:

>> fid=py.open('save_results.pkl','rb');
>> data = py.pickle.load(fid);

Error using libpath>find_lib_path (line 66)

Python Error: XGBoostLibraryNotFound: Cannot find XGBoost Library in the candidate path. List of candidates:

- Library\mingw-w64\bin\xgboost.dll

- C:\Users\20195127\Anaconda3\lib\site-packages\xgboost\../../windows/x64/Release/xgboost.dll

- C:\Users\20195127\Anaconda3\lib\site-packages\xgboost\./windows/x64/Release/xgboost.dll

XGBoost Python package path: C:\Users\20195127\Anaconda3\lib\site-packages\xgboost

sys.prefix:

See: https://xgboost.readthedocs.io/en/latest/build.html for installing XGBoost.

Error in core>_load_lib (line 133)

Error in core><module> (line 174)

Error in __init__><module> (line 9)

Do you know how to solve it?

[Walter Roberson]

I notice that the first of those does not give a fully qualified path, which suggests you might have to be cd'd to a very specific location.... or could suggest that something is misconfigured in the paths

Have you searched your system for xgboost.dll ? Which directories did you find it in?

[Quan minhquanccna]

Below directories that I can find with xgboost.dll:

I also follow this guide to install the xgboost and work with MATLAB. But the problem is still there.

https://www.mathworks.com/matlabcentral/fileexchange/75898-functions-to-run-xgboost-in-matlab

[Yun Guan]

I use the "data=py.pickle.load(fid)" to read my pckl data, but it show"Python error ModuleNotFoundError: No module named 'numpy'" , have you some idea? thanks

[Dev Sarma]

You have to make sure the numpy package is installed. You can install numpy from your command line 'python -m pip install numpy'. (or py instead of python). More information here: https://numpy.org/install/

Answer 2

[Jan]

Did you take the time to search in the net before asking?

• https://xcorr.net/2013/06/12/load-pickle-files-in-matlab/
• https://stackoverflow.com/questions/25859968/in-matlab-how-to-read-python-pickle-file

Does this help already? I do not find a Matlab code to interpret these Python pickle files.

[kc]

these threds are not very useful sir, specially for ppl dnt know python

[Walter Roberson]

The second link shows a few lines of Python needed to read the files and convert them to something usable by MATLAB.

The pickle format is python internal format that is not intended to be human readable, and is documented as not being compatible with other standards: https://docs.python.org/3/library/pickle.html

The data format used by pickle is Python-specific. This has the advantage that there are no restrictions imposed by external standards such as JSON or XDR (which can’t represent pointer sharing); however it means that non-Python programs may not be able to reconstruct pickled Python objects.

Thus you have python-specific datasets, and you would have a hard time reconstructing the data without using python.

See https://www.mathworks.com/help/matlab/call-python-libraries.html for information on calling python from MATLAB.