What’s the Pythonic way to add an LLM-powered REPL to a server?
I'm building a service that I can connect to over HTTPS and interact with through a REPL-like conversational loop. The server should be able to control devices on…
LLM
What’s a Fair Hourly Rate for Beginner Programming Lessons From an AI/ML Engineer?
I don't have a computer science or programming background, and I'm not planning to pursue a career in tech. My romantic partner is currently unemployed, runs a struggling…
What’s a fair hourly rate for beginner programming lessons from an AI/ML engineer?
I'm not in computer science or tech and don't have any programming experience. I'm considering paying my romantic partner to teach me programming, starting with the basics and…
How should I plan and build a school management system with AI integration?
I need to create a semester project for a school management system that includes an AI or LLM feature. I want to genuinely understand what I build instead…
How Can I Make My Kubernetes LLM Setup More Realistic?
I've been diving into a project aimed at exploring how Large Language Model (LLM) workloads function in a Kubernetes environment. My current setup is relatively simple and involves:…
How Do You Manage LLM Drift During Long Development Processes?
I'm curious about how others are dealing with LLM drift in their development workflows. I usually set some constraints like architecture and tools early on, and while the…
How to Manage a Massive Influx of Azure Function Triggers on Launch Day?
I'm working on a document processing system that triggers an Azure Function when scanned PDFs are uploaded to Azure Blob Storage. This Function then calls an LLM (Azure…
How to Tackle AI Autocomplete Issues with Custom Design Systems
I've been grappling with a frustrating issue when using AI autocomplete tools like GitHub Copilot with my custom Tailwind setup. I have specific design tokens like `bg-brand-primary` and…
Best Ways to Limit User Requests Without Making Them Sign Up
I'm working on a small project where I want to create a free site that allows users to input data and gets a workout routine generated by a…
Is there a way to fetch full captions and carousel images from Instagram for an app?
I'm working on an app that I want to publish. The plan is simple: when someone shares an Instagram post URL in my app, I want it to…
Should I Focus on AI Development or Stick with Web Development?
I'm a high school student who just started programming this year. I've been learning Django over the summer and I'm really enjoying it, but I've also been hearing…
How Can I Run Stable GPU Inference on AWS Without Spot Interruptions?
I'm working with a small team on large language model inference using AWS, but we're struggling with frequent spot instance interruptions. We've tried various solutions like capacity-optimized ASGs…
How to Securely Process and Encrypt Sensitive Data with LLMs Without Exposing It to the Cloud?
I'm dealing with some sensitive data that I want to process using a Language Learning Model (LLM). After processing, I need to encrypt this data into a secure…
How can I securely process and encrypt sensitive data without exposing it to Cloud Infrastructure?
I'm handling sensitive data that needs to be processed by a large language model (LLM) and then encrypted into a storage bucket. I want to avoid using the…
Is 850W Power Supply Overkill for My Local LLM PC Build?
I'm planning to build a computer specifically to run a local LLM using Proxmox and Ollama, and I'd like to get your thoughts on my specs. The main…
Struggling to Generate Large Datasets Using Bedrock, Any Tips?
Hey everyone! I recently took part in a hackathon and received $300 in credits. I'm working on creating a synthetic data generator, but I'm hitting some snags. I…
What's the Best Affordable LLM for My Wiki Website?
I'm looking for advice on the best low-cost AI language model that can scan and interact with my wiki website. As someone who's completely new to this, I'm…
What's the Best Low-Cost AI for Scanning My Wiki?
I'm exploring options for a cost-effective AI language model that can scan my wiki website and allow me to ask questions about the content. As a total newbie…
What Led to the Recent Surge in AI Hype?
I'm curious about why the excitement around AI and technologies like ChatGPT has emerged so recently. Were there specific breakthroughs in software or hardware that made this possible…
How Can I Prevent Claude from Making Things Up?
I've been really enjoying using Claude for writing book chapters and creating detailed content, but I keep running into problems with it making stuff up and not being…