Clear images from Kobotoolbox project after fetching it

[nicopace]

From the last onboarding process, the partner said that there is a bug within KoboToolbox. Even though they set up the max filesize, they are not honoring it. I will file a separate issue for this.

Still, most of our partners will eventually face that will have more than one survey running (ie, a continuous cultural mapping) that will eat up all their storage.
From our side, it would be great if we can improve the KoboToolbox gc-scripts-hub script so that we can clear the attachments that were already saved in GC to save space within a KoboToolbox account.

This is the relevant code:

gc-scripts-hub/f/connectors/kobotoolbox/kobotoolbox_responses.py

Lines 293 to 297 in f646865

	for submission in form_submissions:
	if "_attachments" in submission:
	skipped_attachments += _download_submission_attachments(
	submission, db_table_name, attachment_root, headers
	)

[rudokemper]

Just to clarify: you are requesting a modification in our KoboToolbox script to send a request to the KoboToolbox API to delete an image on their end, once we know with 100% certainty that we have downloaded the image, and we can ascertain parity e.g. in filesize. I'm guessing via an optional script param deleteMediaAttachments (boolean). Is that correct?

We have never discussed any of our scripts actually modifying an upstream data source. I think this requires a high-level discussion on whether this is the kind of thing we think is appropriate for gc-scripts-hub (and Guardian Connector in general!), and if so, how. If we do decide to support this use case, I think it should be a separate script from the "Kobo fetch responses" script.

[nicopace]

It is exactly that.
I understand it might need further discussion.
Good that we started this discussion here.

[nicopace]

I just sent a issue to KoboToolbox about this:
kobotoolbox/collect#17

[nicopace]

Exploring alternatives... asked in this repo also to attempt to shrink images as they pass from one form to the other:
DRC-UA/kobo-migration#1 and DRC-UA/kobo-migration#2