Show HN: QVAC SDK, a universal JavaScript SDK for building local AI applications

by qvac 16 comments 30 points
Read article View on HN

16 comments

[−] shaz0x 30d ago
Went through the SDK docs before asking. On RN/Expo specifically, does Fabric run inside a Bare worklet with IPC back to Hermes, or drop into a native module the way llama.rn does via JNI and llama.cpp? Perf and memory footprint would look very different between the two, curious which path you landed on.
[−] WillAdams 35d ago
Do you really mean/want to say:

>...and without permission on any device.

I would be much more interested in a tool which only allows AI to run within the boundaries which I choose and only when I grant my permission.

[−] angarrido 34d ago
Local inference is getting solved pretty quickly.

What still seems unsolved is how to safely use it on real private systems (large codebases, internal tools, etc) where you can’t risk leaking context even accidentally.

In our experience that constraint changes the problem much more than the choice of runtime or SDK.

[−] moffers 35d ago
This is all very ambitious. I am not exactly sure where someone is supposed to start. With the connections to Pear and Tether I can see where the lines meet, but is the idea that someone takes this and builds…Skynet? AI Cryptocurrency schemes? Just a local LLM chat?
[−] elchiapp 35d ago
Hey folks, I'm part of the QVAC team. Happy to answer any questions!
[−] yuranich 34d ago
Hackathon when?
[−] plur9 34d ago
[dead]
[−] eddie-wang 35d ago
[dead]
[−] tuxnotfound 35d ago
[dead]
[−] tuxnotfound 35d ago
[dead]