beegfs integration

[dhelgerson]

BeeGFS 8.x added the Data Management API

Would a port of the lustre-specific features such as changelog integration be a possibility using this API?

[dhelgerson]

this link may be a little more helpful:

https://doc.beegfs.io/latest/advanced_topics/filesystem_modification_events.html

[garadar]

+1

[botinca]

this link may be a little more helpful:

https://doc.beegfs.io/latest/advanced_topics/filesystem_modification_events.html

Just a quick note: this feature (modification events / changelog-like functionality) was actually already available in the 7.X family as well — not just in 8.x with the Data Management API.
See: https://doc.beegfs.io/7.4.3/advanced_topics/filesystem_modification_events.html
So the integration potential for Robinhood might be broader than just targeting 8.x.

[martinetd]

robinhood v3 (current master branch) is pretty closely tied to lustre so I'm not sure it'd be worth the effort, and while it'd likely be possible I'm not convinced anyone will have time to review any such effort.

The v4 branch has a full rewrite that's not compatible at all, so I'm not sure if it'd suit you, but there the changelog processing was cleanly separated and if you make a small service that converts these fs events to the json expected by robinhood then it shouldn't be too much work, and it's much more likely to be mergeable.
(I've been meaning to make such a daemon working with fanotify for local filesystems for home/as a non-lustre example, but never took the time to work on that...)
OTOH https://github.com/cea-hpc/rbh-fsevents that I was about to point to as an example has been archived so I'm not sure it's actually a good advice 😅 ... And it's probably best to wait for actual devs than trust someone who's just lurking around like me.

[martinetd]

I was apparently looking at stale data (people should update readmes), it's all in this repo https://github.com/robinhood-suite/robinhood4/tree/main/rbh-fsevents