Python Channel

I have a numpy script that -- according to top -- is using about 5GB of RAM: PID USER PR NI V… Read more Memory Profiler For Numpy

I m trying to do a some activity on class obj destruction. How do I achive file open in _del__ fun… Read more How To Achive - File Write Open On __del__?

I'm learning about tensor storage through a blog (in my native language - Viet), and after expe… Read more Pytorch Tensor Storages Have The Same Id When Calling The Storage() Method

tl;dr I want to dd.read_parquet('*.parq')['column'].nunique().compute() but I get … Read more Dask Dataframe Nunique Operation: Worker Running Out Of Memory (mre)

I'm trying to understand how python is using memory to estimate how many processes I can run at… Read more Understanding Memory Usage In Python

I'm looking to optimize the code below which takes ~5 seconds, which is too slow for a file of … Read more Optimize Parsing File With Json Objects In Pandas Dataframe, Where Keys May Be Missing In Some Rows

I am looking for a way to create a zipfile in memory and include a symlink inside the zipfile. So f… Read more Create Symlink Inside A Zipfile In Memory Using Python

I am able to understand immutability with python (surprisingly simple too). Let's say I assign … Read more Id Values Of Different Variables In Python 3

How can one convert a huge text file (>16G) containing binary-valued characters (0 and 1) to a n… Read more Convert A Text Of Binary Values To Numpy File

Perhaps this question has been asked before, but I'm having trouble finding relevant info for m… Read more Most Efficient Way To Use A Large Data Set For Pytorch?

I have a complicated python server app, that runs constantly all the time. Below is a very simplif… Read more Pypy Memory Usage Grows Forever?

Is there a way to measure the amount of memory allocated by an arbitrary web request in a Flask/Wer… Read more How To Measure Memory Usage Of A Web Request When Using Werkzeug/flask?

I am dealing with several large txt file, each of them has about 8000000 lines. A short example of … Read more How To Solve The Memory Error In Python

Here is my code: from memory_profiler import profile @profile def mess_with_memory(): huge_lis… Read more What Does "del" Do Exactly?

Okay all you ctypes gurus out there... I've got a python script that reads a memory address a h… Read more Python Readprocessmemory Not Reading Enough Bytes

Does Tensorflow use only dedicated GPU memory or can it also use shared memory? Also I ran this: fr… Read more Tensorflow - Gpu Dedicated Vs Shared Memory

I've tried to understand when Python strings are identical (aka sharing the same memory locatio… Read more How Does Python Determine If Two Strings Are Identical

I have a large series of raster datasets representing monthly rainfall over several decades. I'… Read more How Do I Loop Through A Large Dataset In Python Without Getting A Memoryerror?

I am running a program which loads 20 GB data to the memory at first. Then I will do N (> 1000) … Read more Multiprocessing Global Variable Memory Copying

I have a class and it's method. The method repeats many times during execution. This method use… Read more Should I Preallocate A Numpy Array?