YouTube video by Dr_Al_

YouTube video by Cris ♾️ ICS

YouTube video by Cris ♾️ ICS

Kurz notiert: insureNXT 2025, JAKALA gründet FinTech, neue Privatemode AI, Open Finance/FiDA-Lösungen, digitalen Euro EURQ auf Dusk-Blockchain, ...

Nicht nur Moxie Marlinspike bietet einen E2E-verschlüsselten KI-Chatbot an - auch das deutsche Unternehmen Privatemode. Wir haben den Bot ausprobiert. Ein Test von Tobias Költzsch

Just thought I’d mention here, maybe someone has but I missed it, Duck.ai actually does have one TEE model, gpt-oss. You can’t use the upload feature with it though, but you can search the web, which is nice. I’m currently liking duck.ai for web searches and then Privatemode for things that I don’t need to search. I use Lumo sometimes with very specific prompts but I still just find it limited compared to these other options. I’m trying to wean off Perplexity but its search is so good that I still use it with an anon email in incognito mode.

xe3: > Have you been able to figure out what models confer is using and where they are hosted? I have no idea no, I’m mainly interested in the privacy tech. xe3: > Also is there anything that gives Confer’s approach an edge over others using confidential compute, or is this just the service you chose ot mention/are most familiar with? (others using confidential compute include Maple AI, PrivateMode AI, and Nano-GPT) I just forgot about those other ones. I do think Confer’s use of passkeys as the encryption key is really cool and innovative, I’m not sure if anyone else is doing that.

Breeze7846: > What are the best AI options right now? The list of–interesting to me–privacy centered or privacy-adjacent cloud hosted AI options right now is: * Providers offering TEE / Confidential Compute * Nano-GPT (nano-gpt.com) * PrivateMode AI (privatemode.ai) * Maple AI (trymaple.ai) * Confer AI (confer.to) * Non-TEE / trust based privacy * Duck.ai * Proton Lumo * Brave Leo * Whatever Apple’s muddling their way through * * * On DDG / Lumo / Brave (click for more details) On Nano-GPT's privacy considerations (click for more details) fria: > I’d probably say confer is looking good, Have you been able to figure out what models confer is using and where they are hosted? Also is there anything that gives Confer’s approach an edge over others using confidential compute, or is this just the service you chose ot mention/are most familiar with? (others using confidential compute include Maple AI, PrivateMode AI, and Nano-GPT) lone-cloud: > I haven’t logged in to the hosted confer web app to see what they’re actually exposing there, but anything from OpenAI or TogetherAI is technically super easy for them to add. Afaict when I briefly tested, the webapp didn’t specify which model is being used or offer any control over that. It was a super simple UI (pretty similar look to open-webui if you are familiar, but a bit more basic), no settings, few to no choices, quite barebones. I’m having login issues with their passkey implementation so I can’t login to refresh my memory at the moment.

Tyruke: > Does this make sense? I just don’t understand how the GPU can decrypt a prompt if it was encrypted with a key that only I have. That’s a puzzling part, but I guess it could be like Signal. So the important part is to understand that the encryption is between you and the sandboxed enclave. The thing I am worrying more is to send back the answer, because by definition they have to send you the answer. So how do they encrypt it ? How does the key exchange works? Etc.

So then here is my very basic understand so far… Privatemode’s app has some sort of mechanism in place that verify’s that the hardware that’s going to process your prompt is properly set up for confidential computing. 1. I type a prompt and hit send. 2. My prompt is encrypted on my device locally 3. My prompt arrives to the GPU encrypted 4. The GPU decrypts my prompt to plain text, processes it, and gives a plain text response. During this part, the plain text data the GPU is processing can’t be accessed by anyone, including the service provider, or even someone with physical access to the hardware. So this is the sandbox? 5. The plain text response is encrypted and sent back to the me. 6. The encrypted response is finally decrypted on my device locally. Does this make sense? I just don’t understand how the GPU can decrypt a prompt if it was encrypted with a key that only I have.

This **isn’t the same as E2EE**. A remote server still processes your prompts in plaintext, but it’s just that the part that processes your prompts is sand boxed and doesn’t have network access. > Users interact directly with the AS [Attestation Service] and the workers or through a trusted web service. Users verify the deployment using the AS and set their inference secrets. Then they can send encrypted prompts to the service. The encryption proxy decrypts these prompts, forwards them to the sandbox, re-encrypts the responses, and sends them back to the user. > > > The main difference with E2EE is that any vulnerabilities along the process and there can be leaks.

It sounds like Apple’s Private Cloud compute, where to my understanding, data processed on their servers is inaccessible. Basically, even though their computers are running the AI that you prompt, they can’t really see what you’re doing. Blog - Private Cloud Compute: A new frontier for AI privacy in the cloud - Apple... ### Blog - Private Cloud Compute: A new frontier for AI privacy in the cloud -... Secure and private AI processing in the cloud poses a formidable new challenge. To support advanced features of Apple Intelligence with larger foundation models, we created Private Cloud Compute (PCC), a groundbreaking cloud intelligence system... This Privatemode seems pretty interesting, maybe we could open up a topic asking for it to be added to the AI chat section

External Image privatemode.ai ### Privatemode AI - The always encrypted AI service Privatemode is the first AI service that protects the confidentiality of your data end-to-end. Use AI without security and privacy worries. If you look at their site menu and go to security they claim to use something called “confidential computing”, but I don’t know or understand that technology. Does any one know what it is?

So I found a blog from Nvidia from July 2024 about this. NVIDIA Technical Blog – 2 Jul 24 ### Advancing Security for Large Language Models with NVIDIA GPUs and Edgeless... Edgeless Systems introduced Continuum AI, the first generative AI framework that keeps prompts encrypted at all times with confidential computing by combining confidential VMs with NVIDIA H100 GPUs… It seems that Privatemode used to be called Continuum AI (because the link in this article goes to Privatemode’s website. This paragraph was particularly interesting. > Continuum addresses the problem by running the AI code inside a sandbox on the confidential computing-protected AI worker. In general terms, a sandbox is an environment that prevents an application from interacting with the rest of a system. It runs the AI code inside an adapted version of Google’s gVisor sandbox. This ensures that the AI code has no means to leak prompts and responses in plaintext. The only thing the AI code can do is receive encrypted prompts, query the accelerator, and return encrypted responses.

 Der stets verschlüsselte KI-Dienst. Privatemode ist der erste KI-Dienst, der die Vertraulichkeit Ihrer Daten von Anfang bis Ende schützt. Medienmitteilung von Edgless Systems: "Bochum, 19. Februar 2025 Edgeless Systems, Spezialist für hochsicheres…

+++ #StartupTicker +++ E-Commerce-Dickschiff SellerX streicht jede fünfte Stelle +++ 1Komma5° trotz Rezession auf 520 Millionen Umsatz +++ So tickt Tanja Emmerling (HTGF) +++ Spannende deutsche KI-Sta...