This thread is how I started going down the rabbit hole of building my own ISP pipeline - hope this potentially helps to any future viewers. The initial prototype is in Python, but I will likely rerwrite it into C++ as I do have some experience with building hardware bound systems.