With little time to equip, 300 well-trained men can defeat a much greater opponent. With much time to equip, one man can defeat 300 well-trained men.
The pen is mightier than the sword.
When will the left hemisphere and right hemisphere, that of LLM + SDXL, respectively, be bridged by interoperability? CHG had the technology long since…
https://nnt339es.hatenablog.com/entry/2022/07/31/045059
Hi everyone, First time posting on here. Tried my best to type this out to help out anyone who wants to give this a try. # What does this GPU-P function do? A few months back, Microsoft apparently implemented a HyperV function called GPU-P...
Reading time: 65 mins 🕑
Likes: 200 ❤
Docker has significantly improved the way we build, ship and run apps. Read this tutorial to learn how to integrate Docker with your Node.js application.
Est. reading time: 16 minutes
Before you begin You must use a kubectl version that is within one minor version difference of your cluster. For example, a v1.29 client can communicate with v1.28, v1.29, and v1.30 control planes. Using the latest compatible version of kubectl helps...
For the last few months, I have been acting as Developer Advocate for the OVH Managed Kubernetes beta, following our beta testers, getting feedback, writing docs and tutorials, and generally helping to make sure the product matches our users' needs...
Estimated reading time: 7 minutes
kubernetes, microk8s
Today, we're excited to announce the ngrok ingress controller, our native and open-source Kubernetes (k8s) resource for adding public, secure, and high-available ingress traffic to your k8s clusters.
https://kubeovn.github.io/docs/v1.12.x/en/ https://docs.olcf.ornl.gov/services_and_applications/slate/use_cases/nginx_hello_world.html
Kubernetes Install MetalLB Loadbalancer. We look at installing MetalLB in a bare-metal Kubernetes cluster, including testing with Nginx pod
Est. reading time: 7 minutes
Working with local Kubernetes cluster such as minikube, k3s, microk8s or others is great for testing new features, experimenting and…
Reading time: 4 min read
Set up Kubernetes Ingress on MicroK8s to test how it works and prepare for applying it to your production cluster. This guide shows you how,
Est. reading time: 6 minutes
https://kubeovn.github.io/docs/v1.12.x/en/advance/with-ovn-ic/
https://hub.docker.com/r/msxlol/tensorflow-directml-sample
The k-means algorithm is widely used for clustering, compressing, and summarizing vector data. We present a fast and memory-efficient GPU-based algorithm for exact k-means, Asynchronous Selective Batched K-means (ASB K-means). Unlike most GPU-based...
https://rocm.docs.amd.com/en/latest/how_to/tuning_guides/w6000_v620.html
Nx Desktop requires a computer which supports OpenGL 2.1 or higher. Typically, this is not an issue, but in some cases, a need arises to launch the desktop client application on computers with limi...
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models. - GitHub - oobabooga/text-generation-webui: A Gradio web UI for Large Language Mod...
https://bellard.org/
https://virtualizeeverything.com/2021/01/23/set-up-a-tor-proxy-in-proxmox-container/
https://hub.docker.com/r/davd/docker-ddns
In this guide I’ll show you how to get stable diffusion up and running on your 100$ Mi25 on linux Cooling This thing does not come with a fan, you need to rig up your own cooling solution This thing is HOT and its heatsink is not that...
Reading time: 46 mins 🕑
Likes: 112 ❤
https://pve.proxmox.com/wiki/Install_Proxmox_VE_on_Debian_11_Bullseye
https://www.zb-c.tech/2022/11/20/amd-instinct-mi25-machine-learning-setup-on-the-cheap/
Here’s Doom 2016 running on it Here’s Warzone, same inadequate CPU Quake Champions works out pretty well on this level of hardware. Been having display flicker issues lately that I haven’t been able to...
Reading time: 26 mins 🕑
Likes: 91 ❤
🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision - GitHub - huggingface/accelerate: 🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-prec...
https://www.reddit.com/r/unRAID/comments/nqj3o5/flashing_lsi_sas_92118i_to_it_mode/ https://www.reddit.com/r/docker/comments/10dsn6p/how_do_you_pass_amd_gpus_and_intel_gpus_through/
I know I've been able to get k3s running on my LXC containers in the past. This was when I just ran a straight up OS and setup LXD myself.
Then I decided to try and be clever, wiped my box, and installed Proxmox in order to, among other things,...
lxc
https://medium.com/nerd-for-tech/use-your-amd-gpu-to-speed-up-training-rocm-87e34ff3554
Dockerfile
FROM rocm/composable_kernel:ck_ub20.04_rocm5.5_rc4
RUN mkdir /SD
# Clone SD
WORKDIR /SD
RUN git clone https://github.com/AUTOMATIC1111/stable-diffusion-webui
WORKDIR /SD/stable-diffusion-webui
RUN git reset --hard 22bcc7be428c94e9408f589966c2040187245d81
show original
Magnet link to composable_kernel:ck_ub20.04_rocm5.5_rc4
magnet:?xt=urn:btih:dc9b3ec573f4deb765952ddfa764b1d9e9512c6f&xt=urn:btmh:12203daea6d9ea069933e19403d4050463b3f014c034237a2934cbd01f8aa8f75b36&dn=rocm5.5.tar.gz&tr=udp%3a%2f%2ftracker.opentrackr.org%3a1337%2fannounceREADME.md
To use this container you would first need to install docker and docker-compose.
After that you would need deleted rocm/composable_kernel:ck_ub20.04_rocm5.5_rc4 docker image (alpha build of ROCM). You can download the image, using bittorect magnet link in the files of the gist. After downloading the image load it with docker load --input rocm5.5.tar.gz
Running is as simple as: sudo docker-compose up --build.
After that Stable Diffusion Web UI could be accessed in http://127.0.0.1:3000
Many thanks to @wsippel for putting up step by step guide to get it working.
# Disclaimershow original
There are more than three files. show original
https://www.amd.com/system/files/documents/gpu-consistency-security-whitepaper.pdf
Easy-GPU-P Github page:
Example:
Introduction
Reading time: 5 min read
Hackable implementation of state-of-the-art open-source LLMs based on nanoGPT. Supports flash attention, 4-bit and 8-bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-l...
https://github.com/ZCHGorg/CHG-2.0
docker
At AMD’s Epyc launch few weeks ago, Lisa Su, Mark Papermaster, and the rest of the AMD Epyc team hammered home that AMD designed its new Zen processor core for servers first. This server-first approach has implications for performance, performance...
Est. reading time: 10 minutes
https://www.jeffgeerling.com/blog/2022/getting-rx-6700-xt-work-gaming-on-linux
NVIDIA GTC21 had numerous great and engaging contents, especially around RAPIDS, so it would be easy to miss our debut presentation “Using RAPIDS to Accelerate Node.js JavaScript for Visualization and…
Confused about GPU allocation in Hyper-V
Hi everyone,
I'm running Windows 11 with a 4090 GPU and have been using the easy-gpu-pv scripts to create a virtual machine with GPU resource allocation set to 50%.
From what I understand, this means that the...
https://www.sciencedirect.com/science/article/abs/pii/S1568494623005173
evm, docker
---
layout: global
title: Running Spark on Kubernetes
license: |
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements. See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to You under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
---
* This will become a table of contents (this text will be scraped).
show original
Read this article's comment section on news.ycombinator.com
1 Abstract
The following document describes the reasoning behind the creation of LibVF.IO, some basic definitions relating to GPU virtualization today, and a guide to using LibVF.IO for...
Researchers from the University of Jyväskylä were able to simplify the most popular technique of artificial intelligence, deep learning, using 18th-century mathematics. They also found that classical training algorithms that date back 50 years work...
When discussing GenAI, the term “GPU” almost always enters the conversation and the topic often moves toward performance and access. Interestingly, the word “GPU” is assumed to mean “Nvidia” products. […]
Est. reading time: 5 minutes
CasaOS - A simple, easy-to-use, elegant open-source Personal Cloud system. - GitHub - IceWhaleTech/CasaOS: CasaOS - A simple, easy-to-use, elegant open-source Personal Cloud system.
https://docs.start9.com/latest/developer-docs/ https://www.reddit.com/r/LocalLLaMA/comments/17coljw/memgpt_towards_llms_as_operating_systems_uc/
Discord is the easiest way to communicate over voice, video, and text. Chat, hang out, and stay close with your friends and communities.
Web 4.0 is Terminator re-programmed for good , C3PO developed for local AI cloud as distinct from conglomerate AI cloud, AI programmed to your parameters and not the corporate mecca. And of course distributed power, energy, and information - P2P internet and TRULY distributed blockchain. CHG pioneered 3.0 stand-alone many years ago and Web 4.0 is for YOU, the reader, to develop further. Web four, it’s YOURS!
It’s happening! The homelab world is coming online everywhere you look! Homelab will have proven a huge part of Web 4.0 and beyond. The private cloud meets distributed storage, fully encrypted end-to-end with users choosing their encryption tech.
https://www.reddit.com/r/homelab/
## Docker volume backup
How to backup docker volumes. Docker volumes can be a hassle to back up to another place.
I implemented my backup strategy with the help of the docker-volume-backup container.
Check out the offen/docker-volume-backup [github page](https://github.com/offen/docker-volume-backup).
My implementation is running just next to my other docker-compose stacks and from there it can access the volumes to be backed up, syncs them into another remote storage and also encrypts them with GPG.
[Link to the YouTube video](https://youtu.be/qlo0Z1I1DD0)
Project structure:
```
.
├── README.md
├── backup-configuration
│ ├── mongo-dump.env
│ └── uptime-kuma.env
├── backup.env
└── docker-compose.yml
```
show original
Backup Docker volumes locally or to any S3, WebDAV, Azure Blob Storage, Dropbox or SSH compatible storage
https://hub.docker.com/r/nginxproxy/nginx-proxy
Evaluate all the different options for secrets management solutions ranging from using cross-cloud tools, to open source projects, to building in-house. Learn which tools are the best, and how they compare with each other.
https://www.reddit.com/r/docker/comments/f1tlx7/docker_secrets_alternative_or_should_i_just_use/
CyberArk Conjur automatically secures secrets used by privileged users and machine identities
Docker image for running duplicity in a cron
https://www.google.com/search?q=encrypted+runtime&ie=UTF-8&oe=UTF-8&hl=en-us&client=safari
