111 Commits

Author	SHA1	Message	Date
Peter Stuifzand	c9543e7a83	Problem: feeds are fetched every hour and haven't changed, or have changed often ... Solution: implement histogram buckets for feed polling The feeds are now implemented in tiers. The tier is the bucket the feed is in. To calculate the minutes to wait for when to fetch the next feed, you add 2**tier minutes to the current time. The feeds to fetch are filter by this time.	2022-04-16 14:55:22 +02:00
Peter Stuifzand	90074d28d6	Problem: licenses in files are not regular ... Solution: Paste license on top of all files. This does not change the license. It was already licensed as GPLv3.	2021-11-20 22:26:39 +01:00
Peter Stuifzand	bfe52d0f2a	Problem: break statements are redundant in switch statement ... Solution: remove break statements	2021-11-20 21:38:06 +01:00
Peter Stuifzand	ec8b2805f5	Problem: condition is unnecessarily complex ... Solution: simplify condition	2021-11-20 21:34:46 +01:00
Peter Stuifzand	7a9777b416	Problem: fetch2 is unused ... Solution: remove fetch2	2021-11-20 21:33:41 +01:00
Peter Stuifzand	9c8cec2c5b	Problem: error values are ignored ... Solution: handle error values	2021-11-20 21:26:06 +01:00
Peter Stuifzand	892a9cec72	Problem: memorybackend is a hubbackend ... Solution: memorybackend has a hubbackend	2021-11-10 23:15:45 +01:00
Peter Stuifzand	a75bbb2551	Problem: HubBackend depends on ProcessContent in memorybackend ... Solution: Create interface for memorybackend and depend on that.	2021-11-10 22:53:51 +01:00
Peter Stuifzand	feb59bfab1	Try to generate multiple uid before failing	2021-11-02 22:00:10 +01:00
Peter Stuifzand	21c226ce56	Re-enable CreateFeed for WebSub	2021-10-31 15:04:26 +01:00
Peter Stuifzand	3a43844e93	Fix foreign key errors for feed_id ... Fix usage of QueryRow.Scan	2021-10-31 14:51:31 +01:00
Peter Stuifzand	26b85152fd	Move subscriptions to database	2021-10-31 14:24:41 +01:00
Peter Stuifzand	4f6ea0efb2	Don't use LastInsertId() with postgres	2021-10-31 02:03:38 +02:00
Peter Stuifzand	f83970446e	Log feed ID on ProcessContent error	2021-10-31 01:56:55 +02:00
Peter Stuifzand	64ae959670	Use database backend instead of backend.json	2021-10-31 01:37:39 +02:00
Peter Stuifzand	b608fe6bc6	Create Fetcher interface and use it	2021-10-30 21:09:27 +02:00
Peter Stuifzand	3365b38e5a	Create more notifications for errors while processing feeds	2021-10-29 23:58:58 +02:00
Peter Stuifzand	79b0d719ec	fix: read twice from body	2021-10-21 23:14:55 +02:00
Peter Stuifzand	6e347bd493	Replace sourced items	2021-10-21 23:08:57 +02:00
Peter Stuifzand	a331f4a300	Add Source to Preview items	2021-10-21 22:10:08 +02:00
Peter Stuifzand	5eed538bd1	Fill item source from FeadHeader	2021-10-21 21:47:37 +02:00
Peter Stuifzand	c49afabaa8	add removeFeed to remove feed from channels	2021-10-21 21:21:38 +02:00
Peter Stuifzand	fff2a92b72	breaking change: make "postgres-stream" the default channel type	2021-10-21 20:03:03 +02:00
Peter Stuifzand	b4cc885103	eksterd: add channel to search results	2021-06-01 00:04:39 +02:00
Peter Stuifzand	f14e6d8249	Add full text search to server ... Adds Blevesearch to the server. Every item that is processed by the server is added to the index and can be returned from the ItemSearch request.	2021-05-30 22:01:34 +02:00
Peter Stuifzand	9d81cc9a3a	Add logging for timeline fetching	2021-05-13 21:56:23 +02:00
Peter Stuifzand	9c4a166b45	Extract database, add refreshFeeds	2021-05-11 22:23:45 +02:00
Peter Stuifzand	1b02a8181a	Fetch the channel when it doesn't exist	2020-08-19 16:06:55 +02:00
Peter Stuifzand	08ae30b305	Only send 'delete channel' event when channel was removed	2020-08-09 10:06:12 +02:00
Peter Stuifzand	330931742b	Add event 'delete channel'	2020-08-09 09:59:11 +02:00
Peter Stuifzand	1144c615da	Add 'new channel' and 'update channel' events	2020-08-09 09:50:23 +02:00
Peter Stuifzand	d4de6faa89	Save and use excluded types	2019-08-19 20:32:30 +02:00
Peter Stuifzand	19f3177f66	Add UI for saving excluded post types	2019-08-19 20:16:48 +02:00
Peter Stuifzand	f8b9003c36	Specify names of new item event fields	2019-08-18 13:46:37 +02:00
Peter Stuifzand	b3ecad3c92	Add channel to new item message	2019-08-18 13:15:03 +02:00
Peter Stuifzand	46c308619e	Only update unread count when it has changed	2019-08-17 22:08:22 +02:00
Peter Stuifzand	d2fc2ecd3c	Added boolean to show when item was added to channel	2019-08-17 16:55:59 +02:00
Peter Stuifzand	8493175f4c	Improve error handling while loading	2019-08-06 21:38:19 +02:00
Peter Stuifzand	15d7c69c30	Implement events handling and add documentation	2019-03-24 16:21:38 +01:00
Peter Stuifzand	1e00d32aed	Split of StartConnection code from microsub server	2019-03-24 15:15:55 +01:00
Peter Stuifzand	2d39edac8e	Remove receiver from auth methods	2019-03-24 10:25:40 +01:00
Peter Stuifzand	ed90ebbdd3	Improve error handling in authentication	2019-03-23 21:29:48 +01:00
Peter Stuifzand	42431954e2	Move getTimeline to memory.go	2019-03-23 20:43:22 +01:00
Peter Stuifzand	a23b31cefe	Move timeline backend to own package	2019-03-23 20:42:13 +01:00
Peter Stuifzand	baab9e6051	Initialize pool earlier	2019-03-23 19:38:25 +01:00
Peter Stuifzand	76819ac804	Remove global variable pool and replace fetcher with func	2019-03-23 18:23:56 +01:00
Peter Stuifzand	8f59930268	Improve docs	2019-03-20 20:53:36 +01:00
Peter Stuifzand	ea6d779d4e	Update channelcount	2019-03-07 21:44:49 +01:00
Peter Stuifzand	9d3a23e5e4	Add channel type selection to the web interface	2019-03-07 21:30:12 +01:00
Peter Stuifzand	70f5fb82f9	Improve source code	2019-03-07 20:55:25 +01:00