Commit graph

595 commits

Author SHA1 Message Date
Laura Hausmann
05f6546f48
[backend/core] Improve emoji detection regex, add unit tests 2024-08-16 20:54:24 +02:00
Laura Hausmann
173fbfb835
[backend/asp] Return error responses as HTML/XML/JSON depending on accept header 2024-08-16 01:00:43 +02:00
Laura Hausmann
8889510811
[backend/drive] Fix ImageSharp image scaling for horizontal images 2024-08-14 21:15:33 +02:00
Laura Hausmann
8267bc06de
[backend] Code cleanup 2024-08-14 03:53:15 +02:00
Laura Hausmann
4f98fa8461
[backend/federation] Fix possibly unbounded UserResolver recursion 2024-08-14 03:44:14 +02:00
Laura Hausmann
c3eacb34c2
[backend/federation] Add support for hubzilla's hashtag formatting
A bit strange but here we are
2024-08-14 02:01:56 +02:00
Laura Hausmann
b69f92dbdc
[backend/core] Stricter local user username validation 2024-08-14 00:40:58 +02:00
Laura Hausmann
acbedd3bae
[backend/federation] Support WebFinger reverse discovery (ISH-364)
This resolves federation issues with old versions of pixelfed, as well as various AP implementations that are not widely deployed.
2024-08-13 23:58:46 +02:00
Laura Hausmann
2506e42733
[backend/core] Remove no-duplicate request/job id from log messages 2024-08-13 20:57:06 +02:00
Laura Hausmann
dba3fc1a6a
[backend/core] Add request/job id to logs, improve log formatting 2024-08-13 20:47:06 +02:00
Laura Hausmann
f7a5d86326
[backend/drive] Fix LibVips autorot error
The error message said that the operation must be mutable, but it only works when the operation is not mutable. Oh well.
2024-08-12 03:21:04 +02:00
Laura Hausmann
871c20c3fa
[backend/drive] Add warning logs when no image processor supports encoding the selected format 2024-08-12 03:21:04 +02:00
Laura Hausmann
67a62fadc9
[backend/drive] Move ImageProcessor.cs into the ImageProcessing subfolder 2024-08-12 03:21:04 +02:00
Laura Hausmann
1d31553199
[backend/drive] Add option to reject images that exceed the maximum media processing resolution 2024-08-12 03:21:03 +02:00
Laura Hausmann
f903a1d8a4
[backend/drive] Fix missing image processing resolution check 2024-08-12 03:21:03 +02:00
Laura Hausmann
7b3e9bbbca
[backend/drive] Fix duplicated dots in file extensions in some circumstances 2024-08-12 03:21:03 +02:00
Laura Hausmann
aac4be5893
[backend/drive] Add MIME detection capabilities to LibVips 2024-08-12 03:21:03 +02:00
Laura Hausmann
807a6fc95d
[backend] Refactor dictionary initializers to use the new syntax 2024-08-12 03:21:03 +02:00
Laura Hausmann
1fba1ab119
[backend/drive] Add ImageProcessorConcurrency configuration option, default it to 8 (was: unrestricted) 2024-08-12 03:21:03 +02:00
Laura Hausmann
aaf3be209d
[backend/drive] Add advanced image processing pipeline configuration options (ISH-436, ISH-446)
This commit allows advanced configuration of the image processing pipeline. Exposed options include the format (WebP, AVIF & JXL), as well as encoding parameters. These can be set individually for any combination of image version (original/thumbnail/public) & image origin (local/remote).
2024-08-12 03:21:03 +02:00
Laura Hausmann
c07bb35548
[backend/drive] Refactor ImageProcessor into a modular system
This commit lays the groundwork for a user-configurable image processing pipeline. It has exactly the same behavior as the old ImageProcessor, just modular & compartmentalized. It also adds support for AVIF & JXL encoding, though no code paths call it just yet.
2024-08-12 03:21:03 +02:00
Laura Hausmann
8e99012790
[backend] Fix build
This reverts commit 05e6e40d7e.
2024-08-07 01:05:57 +02:00
Laura Hausmann
05e6e40d7e
[backend] Code cleanup 2024-08-06 23:43:14 +02:00
Laura Hausmann
685f317190
[backend/drive] Fall back to block copy if memory region is not contiguous during ImageSharp blurhash computation 2024-08-06 23:40:20 +02:00
Laura Hausmann
786c4b0085
[backend/drive] Improve safety of ImageSharp blurhash code 2024-08-06 22:56:42 +02:00
Laura Hausmann
d371e6732c
[backend/drive] Significantly improve ImageSharp blurhash performance & memory efficiency 2024-08-06 22:43:04 +02:00
Laura Hausmann
b5a1c1ba85
[backend/drive] Significantly improve LibVips blurhash performance & memory efficiency
This commit saves ~2.5ms & ~1.4MB of heap allocations during blurhash computation using the LibVips image processor.
2024-08-06 22:25:24 +02:00
Laura Hausmann
fcc04d5fd2
[backend/drive] Improve logging for exceptions during DriveService.StoreFile 2024-08-06 14:21:32 +02:00
Laura Hausmann
a8a53542ce
[backend] Code cleanup 2024-07-29 00:51:36 +02:00
Laura Hausmann
7e4282b386
[backend/drive] Switch to stream processing for remote media
This makes sure that files larger than the configured maximum remote media cache size are not loaded into memory (if the size is known), or are only loaded into memory until the configured maximum size before getting discarded (if the size is not known)
2024-07-28 23:32:04 +02:00
Laura Hausmann
15d955c478
[backend/core] Limit HttpClient buffer size to 1MiB, except DriveService from this policy (until proper limits are in place there) 2024-07-28 22:06:33 +02:00
Laura Hausmann
828b742a3f
[backend/drive] Don't attempt to clone remote files, improve deduplication handling 2024-07-27 16:04:02 +02:00
Laura Hausmann
e17cd0ac33
[backend/queue] Better explain the race condition that was recently resolved 2024-07-27 02:12:05 +02:00
Laura Hausmann
6d111e3e45
[backend] Fix typo 2024-07-27 02:06:39 +02:00
Laura Hausmann
7b415d4063
[backend/queue] Add a detailed explanation of the queue system algorithm 2024-07-27 01:54:07 +02:00
Laura Hausmann
ec6b6ee17f
[backend/drive] Limit ImageSharp memory allocation to a computed value instead of a constant one 2024-07-26 23:35:27 +02:00
Laura Hausmann
e885f753a1
[backend/queue] Code cleanup 2024-07-25 01:35:17 +02:00
Laura Hausmann
6c3f78a18b
[backend/queue] Improve shutdown process 2024-07-25 01:29:50 +02:00
Laura Hausmann
a845405c45
[backend/queue] Fix QueueService race condition (properly this time)
While the previous fix was likely enough, there was still a razor-thin theoretical race condition remaining. This commit fixes said race condition, and simplifies some if statements across the file.
2024-07-25 01:29:32 +02:00
Laura Hausmann
09777fe6c4
[backend/queue] Code cleanup 2024-07-25 00:09:13 +02:00
Laura Hausmann
0f400e8023
[backend/queue] Remove cluster mode (ISH-141)
This is wontfix for now, though we might reevaluate this later.
2024-07-25 00:00:43 +02:00
Laura Hausmann
2d178e5a9a
[backend/queue] Allow configuring worker types in cluster mode (ISH-141) 2024-07-24 20:39:45 +02:00
Laura Hausmann
d7cfc24320
[backend/queue] Refactor cluster mode event methods to have less confusing method signatures 2024-07-24 18:01:26 +02:00
Laura Hausmann
4d0ccf1e74
[backend/core] Don't queue poll expiry jobs when expiry is more than 1 year in the future 2024-07-23 20:19:33 +02:00
Laura Hausmann
7ea2f71abe
[backend/queue] Fix QueueService race condition causing transient queue stalls 2024-07-22 05:59:20 +02:00
Laura Hausmann
100d74175a
[backend/drive] Switch to ImageSharp fork supporting IsAnimated metadata property
This fixes compatibility with all animated webp/png images.
2024-07-17 21:15:59 +02:00
Laura Hausmann
12cbc40f99
[backend/drive] Add flag that skips image processing; skip image processing for emojis by default 2024-07-17 17:49:43 +02:00
Laura Hausmann
c0835d0cc7
[backend/drive] Correctly process animated PNG images 2024-07-17 17:47:04 +02:00
Laura Hausmann
d602d766fa
[backend/plugins] Migrate from Weikio.PluginFramework to Iceshrimp.AssemblyUtils 2024-07-15 01:02:41 +02:00
Laura Hausmann
1e8f1cb964
[backend/database] Migrate references to Note.ThreadId ?? Note.Id to Note.ThreadIdOrId 2024-07-14 22:06:29 +02:00