Batch generation

[stormsson]

How to use GitHub

• Please use the 👍 reaction to show that you are interested into the same feature.
• Please don't comment if you have no relevant information to add. It's just extra noise for everyone subscribed to this issue.
• Subscribe to receive notifications on status change and new comments.

---

Feature request

Which Nextcloud Version are you currently using: (see administration page)
Nextcloud Hub 10 (31.0.6)

Is your feature request related to a problem? Please describe.
I am using Nextcloud for a private cloud with a low resource server; the preview generation for the whole filesystem would actually saturate the machine resources

Describe the solution you'd like
I would propose to add a parameter to limit the amount of previews generated for each iteration, like
preview:generate-all --num=5000 to elaborate at most 5000 files

Describe alternatives you've considered
Halting the generation manually after some minutes

Additional context
none

[st3iny]

In theory, I like the idea.

However, the problem is that preview:generate-all does not track state about its progress, so there is no way for the command to know where it stopped last time. We would either need to implement some kind of state to make this work or perhaps add this argument to preview:pre-generate instead.

[stormsson]

@st3iny What about this:

2 parameters are managed: --limit and --offset

• --limit elaborates that amount of files considering the content sorted in an alphabetically sorted list
• --offset (if present) defines how many items to skip from the alphabetically ordered list

(Obviously I don't know how the script works so sorry if this is a non ideal suggestion)

[st3iny]

I like the idea. However, the way the command walks the file tree doesn't allow this. Your suggestion would work if the generate-all command did a database query on the file cache, in which case a simple ORDER BY paired with OFFSET and LIMIT (SQL) would work.

However, the command uses Nextcloud's public PHP APIs does something like this instead:

1. Get user's home folder.
2. List all files/folders inside this folder.
3. If file -> gen preview
4. If folder -> goto 2