Firehose/Jetstream ingestion

[julia.pink]

Hi all!

I recently published a community.lexicon.calendar.eventrecord to my pds and was surprised to find it not display on Smoke Signal. After poking around in the source code and chatting with Boris I’ve come to the conclusion that Smoke Signal does not create new events from the Firehose/Jetstream.

Is there any intentions to change this in the future?

I’m part of the Weekly Seattle ATmosphere Work Session, and we’d love to host our events in the ATmosphere, but due to their being no API, or method to create recurring events we find the time investment of creating weekly events cumbersome.

Thanks for all the help and hardwork in the ecosystem!
Julia

[ngerakines]

Hello!

It might be a bug? I checked the DB and saw that your identity profile record has both the discover_events and discover_rsvps columns set to true, so if you created an event as the identity @julia.pink (did:plc:kaxrtwbltajvychfn33hltvz) then it should have imported.

I took a quick glance at your PDS at://did:plc:kaxrtwbltajvychfn33hltvz and didn’t see any event records. If you created them under a different identity, could you provide some additional information?

I’m not sure where you were looking or what conclusions you came to, but the code for all of that can be traced through the following source files:

• src/bin/smokesignal.rs lines 281-400
• src/consumer.rs (all of it)
• src/processor.rs (all of it)

[ngerakines]

Also just to reiterate, Smoke Signal has event discovery but it requires explicit consent before ingesting anything. Check out the documentation on discovery for more information.

Event Discovery

Smoke Signal automatically finds events created across the ATProtocol network, which means you can see community events from different apps that support the same event format we use. Think of it like a shared event calendar that works across multiple platforms - when you create an event in one place, it can show up in others too. Here’s the thing though: even though content on ATProtocol is generally public (it’s designed to be like a “public square”), we believe you should have control over wh…

[julia.pink]

Hey Nick! thanks for the quick reply. I was publishing the records on a separate account: at://did:plc:p5vlehljnyynmis24wqslprv.

It has both of the discovery options enabled in settings, so possibly a bug. Interestingly when I click “Import records” everything comes in fine. Looking at the code I can’t immediately see what is wrong. I’ll keep poking around, but if you want to look at the same time:

Here is the record which my script is currently creating at://did:plc:p5vlehljnyynmis24wqslprv/community.lexicon.calendar.event/3lxdivs34sy2v. Which is based off of a record someone else in the Work Session made through Smoke Signal which got published at://did:plc:2oatrxtnqmuv53gkhvjqwmp4/community.lexicon.calendar.event/3lvrmkabl2b2o.

I only looked at the code a bit and missed processor.rs. I checked for calls to event_insert not event_insert_with_metadata. Thanks for clearing that up.