Ever wondered how much VRAM you actually need to run a 13B, 65B, or even 500B language model? This compact, no-fluff guide - mostly a personal reference - breaks down GPU memory needs by model size, quantization, and task complexity. Includes real-world GPU examples with affiliate links for anyone thinking of building or upgrading their own AI rig. Great for hobbyists, tinkerers, and anyone asking, 'Can I run that locally?'
Ever wondered if your compact notebook or mini PC could power serious AI, LLMs, or scientific simulations? In this guide, we show you how to retrofit systems without PCIe slots using M.2 NVMe adapters and GPU expansion boards—enabling multi-GPU setups even on budget hardware. While not a full desktop replacement, this approach offers surprising performance for specific workloads. Perfect for tinkerers, researchers, and hardware hackers.
Want to access your internal JupyterLab instance securely over HTTPS? This quick guide shows how to set up Apache 2.4 as a reverse proxy for JupyterLab 4.2.5, with working websocket support and proper configuration on both ends. Learn how to avoid common pitfalls like broken kernels or missing output—and get your lab running smoothly behind your own public facing reverse proxy
This mini guide walks through compiling and running Ollama on a headless, CPU-only FreeBSD 14.2 system with an Intel Alder Lake-N97 processor. It covers why one might opt for CPU-based inference, the Vulkan-related issue preventing execution without a GUI, and how to disable Vulkan by recompiling from ports. The article provides step-by-step instructions for extracting, modifying, compiling, and installing Ollama, along with details on running inference and transferring models to air-gapped systems.
This article solves the mystery behind some of my FreeBSD systems that had appeared to be randomly freezing and provides a solution to this single specific problem.
Discover how to implement language negotiation on a static website using Apaches mod_rewrite. This article provides a step-by-step guide to serving translated content based on users browser preferences, enabling a seamless multilingual experience without the need for complex server-side scripts or content management systems. Whether you are looking to add multilingual support to your Jekyll-generated site or simply explore the powerful features of Apache, this guide offers clear explanations and practical examples to help you get started.
This concise article provides a detailed guide on installing and running multiple outdated PHP versions on a FreeBSD system using suphp. It covers essential steps such as retrieving specific ports tree revisions, configuring distinct installation paths to prevent version conflicts, and setting up suphp for handling different PHP versions. Emphasizing strict security precautions, the article strongly advises against using this setup in public-facing systems and suggests its use solely for isolated, non-public applications.
Just a short recipe on how to get unique device names for CP2102N serial or RS485 to USB adapters even when they're renumbered by the operating system.
A short summary on how to trigger Jenkins jobs by executing a post-receive commit hook in a git repository
Mini summary on how to configure DHCP failover or load balancing when using ISC-DHCP for legacy IP networks. This is not a full explanation of all details, just a quick sample on how to get up failover in a few minutes.
A mini tutorial on how to configure fetchmail to collect E-Mails from different mailboxes on various remote servers onto a single local mail server on FreeBSD
This short recipe explains how one can recover a Jenkins secret text credential directly using only the web interface
This article is a mini summary of the steps that have been required to migrate from the v2 to the v3 stack of the things network, a community driven LoRA-WAN backend solution.
Mini article that explains the difference between switch and router mode and some of their applications when using the tinc VPN client
A short summary on how one could configure network bridges on a FreeBSD dom0 for Xen
Sometimes it's convenient to add annotations to Grafana dashboards and panels using Grafanas flexible HTTP API instead of writing them into a database and fetching them from there using Annotation queries. Since I lacked a complete example and it took me some minutes to find out how this works this blog post summarizes the process.
A common problem in industry and laboratories - accessing a serial port via the network to allow multiple machines or VMs access the same physical serial port. This blog post explains how to build such an console server on a FreeBSD host offering physical serial ports an FreeBSD as well as Windows clients who are able to access the ports like local ones.
In case one wants to push one's Jenkins RSS feeds to some internal devices or publish them with different credentials than are needed to access the Jenkins server this is a simple scripted solution on how to do this.
Mini blog post that shows how I integrated DHCP events into my automation solution by pushing commit, release and expiry events into my message broker infrastructure
One approach to recover a Windows 10 system from damaged registry hive files in case of missing restore points and registry backups.
A short summary on how to generate a sitemap for search engines automatically when using the Jekyll static site generator
This article describes a simple and working solution to automatically upgrade jenkins running on a local servlet container such as Apache Tomcat by using a simple POSIX compliant shellscript (working on Linux, Unices, etc.) as well as a simple Jenkins job itself.
Minimal description of the two possible activation procedures of LoRA WAN device activation and the meaning of device activation for the network. This article has been written since the difference between OTAA and ABP as well as the reasoning seems to be a problem for some developers.
A short summary of LoRA WAN stuff that's often not seen by device and application manufacturers and developers. This blog post tries to give a short overview of network behavior and internals.
This blog post summarizes the steps for disaster recovery on MariaDB or MySQL in case the database system doesn't start up any more or contains damaged table definitions which might even prevent one from dropping tablespaces or databases.
Since a friend required this - a short writeup on how to use your RaspberryPi (with FreeBSD) with an UMTS/LTE modem to provide internet connectivity to your local network.
Short introduction on how to use lagg(4) to perform automatic switching from ethernet to WiFi and back on FreeBSD.
A short primer on how to get started using Kerberos for authentication inside your network. This includes setup of an kerberos key distribution center (KDC) on an secure host as well as of the server machines against which one will authenticate as well as the required configuration on the clients.
How to get an IPv6 network connection working if your ISP doesn't support IPv6 even today. Also includes a short description on how to do this on an connection using dynamic endpoint adresses.
A short summary on how to configure mpd5 to authenticate against an external PPP provider for PPPoA usage (via PPTP). This is required for authentication with most Austrian (A)DSL providers when using their modems in single user mode.
This article contains a short tutorial about multifactor authentication, various factors that may be used and a tutorial on how to use the Yubikey hardware token for web- and local as well as SSH (pam) authentication on FreeBSD.
Just a short description of what a JWT is, what it can do for one and how they are realized - and why one would want to use them to identify users in one's web application by using JWTs instead of session IDs.
The blogsphere is a web of interconnected websites. As usual websites are linked like all pages in the WWW but on the other hand they provide an easy way of notifying each other of being referenced by a third party. Pingback is - besides trackbacks - the (XML-RPC based) technology used for that notification.
This is an article (in German because of it's specific audience) about SPF and DKIM features that prevent mail spoofing and it's effects on mail forwarding
An easy method to add tags to your static Jekyll generated pages and blogs
A short description how to setup a TOR hidden service or an stealth hidden service and why one would want to do that even if one doesn't offer illegal content
A tutorial on how to automatically manage TLS certificates for various services with DNS challenges and an zone served out of a bind zonefile that is protected via DNSSEC.
A short description of the davlik.vm.* tuneables for memory management tuning on Android devices
A short description how to enable EAP-MD5 authentication for wired 802.1x authentication on Windows 7 since it has been (correctly) disabled for security reasons
Dipl.-Ing. Thomas Spielauer, Wien (webcomplains389t48957@tspi.at)
This webpage is also available via TOR at http://rh6v563nt2dnxd5h2vhhqkudmyvjaevgiv77c62xflas52d5omtkxuid.onion/