Stress test

[xUser5000]

I stress tested the code with large .bib files. I already did that before with a ~300KB file, but this time I tried much larger files.

Method

I couldn't find a BibTeX file with 1GB of data so I downloaded this file. After that, I wrote a script that makes another copy of the file and then starts duplicating its contents over and over again until it reaches a certain size that I specify.

Machine specs

• Processor: Intel Core i5-10210U (1.60GHz × 8)
• RAM: 16GB
• Disk: 240GB SSD
• OS: Ubuntu 20.04 64-bit

Results

After adjusting the size parameter and observing what happens to the plugin when I execute the main command, I came up with the following conclusions:

• If the size is above 512MB (about equivalent to 536870912 Bytes, which is about equivalent to 0x1FFFFFE8 Bytes in Hexadecimal), nothing happens for one or two seconds then the below alert appears:
  
• If the size is below 512MB, nothing happens for about 20 seconds or so, then the call stack will not afford that much data and will throw an error like this:
  
• If the size <= 12MB (which accounts for about 40,000 references), the plugin works fine and there are no issues at all.

[laurent22]

Do you know at what point the "Maximum call stack" error happens? Is that somewhere in your code, or in the library?

Also could you find out what's the actual max file size currently? Is that 12MB or can it be larger?

[xUser5000]

Do you know at what point the "Maximum call stack" error happens? Is that somewhere in your code, or in the library?

It loads the raw contents of the file into memory but then fails when calling citation.js method inside the parsing function.

Also could you find out what's the actual max file size currently? Is that 12MB or can it be larger?

I was not able to exactly determine the max file size, but I'm sure it is between 32MB and 48MB.