Using local models + zkAPI + Tor for private AI
AI summary of the linked articleThe author describes a self-experiment to get personalized diet and exercise recommendations from frontier AI models using their personal health and travel data without leaking private information. A local model, Qwen 3.8 Flash Next, orchestrates the process and writes the queries to remote models, which the author says helped improve the recommendations. The approach uses three privacy layers: the local model to avoid leaking identity through content or writing style, zkAPI to avoid leaking identity through payments, and Tor to avoid leaking it through networking. The author lists deficiencies, including Tor being poorly suited to request-by-request de-linking and adding high latency, the skill file's query strategies being far from optimal, the local model running at 20-30 TPS, and a tradeoff where more privacy limits how much remote models can help. |
1 comment |
More from farcaster.xyz on Kiwi News
|
