Commit graph

1129 commits

Author SHA1 Message Date
Laura Hausmann
e40cd7dbfd
[backend/drive] Add image/heic to the mime type allowlist 2024-08-12 03:21:03 +02:00
Laura Hausmann
1d31553199
[backend/drive] Add option to reject images that exceed the maximum media processing resolution 2024-08-12 03:21:03 +02:00
Laura Hausmann
f903a1d8a4
[backend/drive] Fix missing image processing resolution check 2024-08-12 03:21:03 +02:00
Laura Hausmann
7b3e9bbbca
[backend/drive] Fix duplicated dots in file extensions in some circumstances 2024-08-12 03:21:03 +02:00
Laura Hausmann
aac4be5893
[backend/drive] Add MIME detection capabilities to LibVips 2024-08-12 03:21:03 +02:00
Laura Hausmann
807a6fc95d
[backend] Refactor dictionary initializers to use the new syntax 2024-08-12 03:21:03 +02:00
Laura Hausmann
1fba1ab119
[backend/drive] Add ImageProcessorConcurrency configuration option, default it to 8 (was: unrestricted) 2024-08-12 03:21:03 +02:00
Laura Hausmann
aaf3be209d
[backend/drive] Add advanced image processing pipeline configuration options (ISH-436, ISH-446)
This commit allows advanced configuration of the image processing pipeline. Exposed options include the format (WebP, AVIF & JXL), as well as encoding parameters. These can be set individually for any combination of image version (original/thumbnail/public) & image origin (local/remote).
2024-08-12 03:21:03 +02:00
Laura Hausmann
c07bb35548
[backend/drive] Refactor ImageProcessor into a modular system
This commit lays the groundwork for a user-configurable image processing pipeline. It has exactly the same behavior as the old ImageProcessor, just modular & compartmentalized. It also adds support for AVIF & JXL encoding, though no code paths call it just yet.
2024-08-12 03:21:03 +02:00
Laura Hausmann
8e99012790
[backend] Fix build
This reverts commit 05e6e40d7e.
2024-08-07 01:05:57 +02:00
Laura Hausmann
05e6e40d7e
[backend] Code cleanup 2024-08-06 23:43:14 +02:00
Laura Hausmann
685f317190
[backend/drive] Fall back to block copy if memory region is not contiguous during ImageSharp blurhash computation 2024-08-06 23:40:20 +02:00
Laura Hausmann
786c4b0085
[backend/drive] Improve safety of ImageSharp blurhash code 2024-08-06 22:56:42 +02:00
Laura Hausmann
d371e6732c
[backend/drive] Significantly improve ImageSharp blurhash performance & memory efficiency 2024-08-06 22:43:04 +02:00
Laura Hausmann
b5a1c1ba85
[backend/drive] Significantly improve LibVips blurhash performance & memory efficiency
This commit saves ~2.5ms & ~1.4MB of heap allocations during blurhash computation using the LibVips image processor.
2024-08-06 22:25:24 +02:00
Laura Hausmann
fcc04d5fd2
[backend/drive] Improve logging for exceptions during DriveService.StoreFile 2024-08-06 14:21:32 +02:00
Laura Hausmann
ca9a2b77e9
[backend/masto-client] Respect renoteUri/replyUri on /accounts/{id}/statuses when exclude_replies or exclude_reblogs are set 2024-07-30 02:05:02 +02:00
Laura Hausmann
a8a53542ce
[backend] Code cleanup 2024-07-29 00:51:36 +02:00
Laura Hausmann
7e4282b386
[backend/drive] Switch to stream processing for remote media
This makes sure that files larger than the configured maximum remote media cache size are not loaded into memory (if the size is known), or are only loaded into memory until the configured maximum size before getting discarded (if the size is not known)
2024-07-28 23:32:04 +02:00
Laura Hausmann
15d955c478
[backend/core] Limit HttpClient buffer size to 1MiB, except DriveService from this policy (until proper limits are in place there) 2024-07-28 22:06:33 +02:00
Laura Hausmann
828b742a3f
[backend/drive] Don't attempt to clone remote files, improve deduplication handling 2024-07-27 16:04:02 +02:00
Laura Hausmann
e17cd0ac33
[backend/queue] Better explain the race condition that was recently resolved 2024-07-27 02:12:05 +02:00
Laura Hausmann
6d111e3e45
[backend] Fix typo 2024-07-27 02:06:39 +02:00
Laura Hausmann
7b415d4063
[backend/queue] Add a detailed explanation of the queue system algorithm 2024-07-27 01:54:07 +02:00
Laura Hausmann
ec6b6ee17f
[backend/drive] Limit ImageSharp memory allocation to a computed value instead of a constant one 2024-07-26 23:35:27 +02:00
Laura Hausmann
e885f753a1
[backend/queue] Code cleanup 2024-07-25 01:35:17 +02:00
Laura Hausmann
6c3f78a18b
[backend/queue] Improve shutdown process 2024-07-25 01:29:50 +02:00
Laura Hausmann
a845405c45
[backend/queue] Fix QueueService race condition (properly this time)
While the previous fix was likely enough, there was still a razor-thin theoretical race condition remaining. This commit fixes said race condition, and simplifies some if statements across the file.
2024-07-25 01:29:32 +02:00
Laura Hausmann
4690d5c1fb
[backend/database] Enable connection multiplexing by default 2024-07-25 00:14:16 +02:00
Laura Hausmann
09777fe6c4
[backend/queue] Code cleanup 2024-07-25 00:09:13 +02:00
Laura Hausmann
0f400e8023
[backend/queue] Remove cluster mode (ISH-141)
This is wontfix for now, though we might reevaluate this later.
2024-07-25 00:00:43 +02:00
Laura Hausmann
2d178e5a9a
[backend/queue] Allow configuring worker types in cluster mode (ISH-141) 2024-07-24 20:39:45 +02:00
Laura Hausmann
d7cfc24320
[backend/queue] Refactor cluster mode event methods to have less confusing method signatures 2024-07-24 18:01:26 +02:00
Laura Hausmann
4d0ccf1e74
[backend/core] Don't queue poll expiry jobs when expiry is more than 1 year in the future 2024-07-23 20:19:33 +02:00
Laura Hausmann
8345f35a5f
[backend/federation] Fix (de-)serialization of unordered ASCollection(Page) objects (ISH-427) 2024-07-22 18:57:15 +02:00
Laura Hausmann
c7d0280eb6
[backend] Use SemaphorePlus instead of SemaphoreSlim 2024-07-22 05:59:41 +02:00
Laura Hausmann
7ea2f71abe
[backend/queue] Fix QueueService race condition causing transient queue stalls 2024-07-22 05:59:20 +02:00
Laura Hausmann
ca1f022fc0
[backend/razor] Add overview page to queue dashboard 2024-07-21 23:51:25 +02:00
Laura Hausmann
1f5171eacc
[backend/startup] Add iceshrimp-js migration assistant 2024-07-20 17:10:33 +02:00
Laura Hausmann
100d74175a
[backend/drive] Switch to ImageSharp fork supporting IsAnimated metadata property
This fixes compatibility with all animated webp/png images.
2024-07-17 21:15:59 +02:00
Laura Hausmann
12cbc40f99
[backend/drive] Add flag that skips image processing; skip image processing for emojis by default 2024-07-17 17:49:43 +02:00
Laura Hausmann
c0835d0cc7
[backend/drive] Correctly process animated PNG images 2024-07-17 17:47:04 +02:00
Laura Hausmann
c011253d67
[backend/core] Catch & rethrow HTTP timeout exceptions to shorten unnecessarily long stack traces 2024-07-16 20:53:31 +02:00
Laura Hausmann
751bfe5f8c
[backend/federation] Federate location and birthday profile fields correctly 2024-07-15 15:41:11 +02:00
Laura Hausmann
d602d766fa
[backend/plugins] Migrate from Weikio.PluginFramework to Iceshrimp.AssemblyUtils 2024-07-15 01:02:41 +02:00
Laura Hausmann
1e8f1cb964
[backend/database] Migrate references to Note.ThreadId ?? Note.Id to Note.ThreadIdOrId 2024-07-14 22:06:29 +02:00
Laura Hausmann
6b6bb53668
[backend/masto-client] Add note mute/unmute endpoints (ISH-417) 2024-07-14 22:06:29 +02:00
Laura Hausmann
5182d1bbbb
[backend/federation] Fixup hashtags in incoming notes (ISH-421) 2024-07-14 21:28:20 +02:00
Laura Hausmann
3cb19f376b
[backend/core] Make ICronTrigger file-scoped 2024-07-13 23:55:42 +02:00
Laura Hausmann
a73587d142
[backend/plugins] Allow plugins to instantiate cron tasks (ISH-422) 2024-07-13 23:28:41 +02:00