Prepared for the challenges of tomorrow, today?Where are they? Will they show themselves or at least advance in the ranks without drawing attention to themselves but showing they are looking at what's going on? Civilians aren't just a bunch of saps to be drained of tax money you know. We expect and demand results. And we are hardly getting them. You go to war or engage in actions with the military you are provided with and which we care to sustain. We all need to be smarter about this and I blame the military for squandering resources even more than the politicians.
I am above it all and legit. It's why they will never come for people on 4chan. We can rant our perfectly cogent logic at the best of them and their narrow blinders, as Terry put it, will cause them to turn away.It's OK. The nigger cattle abound.
/lmg/ - a general dedicated to the discussion and development of local language models.Previous threads: >>105354556 & >>105346215►News>(05/23) AceReason-Nemotron-14B math and code reasoning model released: https://hf.co/nvidia/AceReason-Nemotron-14B>(05/23) Ming-Lite-Omni-Preview, unified MoE framework for cross-modal understanding and generation: https://hf.co/inclusionAI/Ming-Lite-Omni>(05/23) Kanana 1.5 Korean model released: https://tech.kakao.com/posts/707>(05/22) MMaDA-8B-Base multimodal large diffusion language model released: https://hf.co/Gen-Verse/MMaDA-8B-Base►News Archive: https://rentry.org/lmg-news-archive►Glossary: https://rentry.org/lmg-glossary►Links: https://rentry.org/LocalModelsLinks►Official /lmg/ card: https://files.catbox.moe/cbclyf.png►Getting Startedhttps://rentry.org/lmg-lazy-getting-started-guidehttps://rentry.org/lmg-build-guideshttps://rentry.org/IsolatedLinuxWebServicehttps://rentry.org/tldrhowtoquanthttps://rentry.org/samplers►Further Learninghttps://rentry.org/machine-learning-roadmaphttps://rentry.org/llm-traininghttps://rentry.org/LocalModelsPapers►BenchmarksLiveBench: https://livebench.aiProgramming: https://livecodebench.github.io/leaderboard.htmlCode Editing: https://aider.chat/docs/leaderboardsContext Length: https://github.com/hsiehjackson/RULERJapanese: https://hf.co/datasets/lmg-anon/vntl-leaderboardCensorbench: https://codeberg.org/jts2323/censorbenchGPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference►ToolsAlpha Calculator: https://desmos.com/calculator/ffngla98ycGGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-CalculatorSampler Visualizer: https://artefact2.github.io/llm-sampling►Text Gen. UI, Inference Engineshttps://github.com/lmg-anon/mikupadhttps://github.com/oobabooga/text-generation-webuihttps://github.com/LostRuins/koboldcpphttps://github.com/ggerganov/llama.cpphttps://github.com/theroyallab/tabbyAPIhttps://github.com/vllm-project/vllm
>>105365080>I don't know what the fuck the default layer splitting logic is but it's REALLY FUCKING BAD.Assuming both GPUs have equal VRAM, the default is to put half the weights on the first GPU and half the model on the second GPU in contiguous blocks.Then the compute graph is constructed for a specific model.Then the compute graph is allocated for the given backends.Some tensors such as weights have a fixed backend assignment, they recursively extend their assignments to tensors that are adjacent in the compute graph.>>105365698>I have no idea if this is it. CUDA DEV, show me how I'm dumb.You're dumb for posting bug reports to 4chan instead of Github.The topmost expert for the tensor allocation logic is slaren, he is whose attention something like this needs to be brought to.I don't have Qwen 235b lying around, when I tried manually assigning tensors of LLaMA 8b or Deepseek V2 Lite to specific GPUs for 2x RTX 4090 the performance was always worse than the automatic assignments.>So, having tensor overrides forces ALL tensors to be on GPU, even the ones that are typically kept on CPU. I think it applies to output tensors.The inputs and outputs tensors need to be in RAM because things like sampling are always done under control of the CPU.If the inputs or outputs are in VRAM they will not be accessible by CPU code and you will get a segfault.>>105366008>This disappears in the -ot version but setting -np manually doesn't make a difference.-np does not have an affect on pipeline parallelism.
lily of the valley
whitoids will never get a loving wife thats why you lil whitemangs are all here on 4chan eternally while we black bvlls are out fucking your women
female, into rape threats. Do your worst and drop your kik
Hey 4chan, hope it's going well, would love to find someone interested in me showing off my IRLs as we have a proper conversation about them, the better the conversation the better the pictures, not looking to mindlessly feed, that isn't all that fun for me.Justacoolcatt
Download (Android/iOS/EGS/Windows)https://wutheringwaves.kurogames.com/en/#mainhttps://store.steampowered.com/app/3513350/Wuthering_Waves/>Wuthering Waves | Resonator Showcase | Ciaccona — THE SONG OF HOPEhttps://youtu.be/G6P_AEmaQL8>Wuthering Waves Resonator Combat Showcase | Ciacconahttps://youtu.be/-7Y4xnrE56A>Second Coming of Solaris Beta Test — 1st Anniversary Trailer Revealhttps://youtu.be/cUSQMHhySr4>Wuthering Waves Version 2.3 Official Trailer | Fiery Arpeggio of Summer Reunionhttps://youtu.be/-OefVumacms>Map:https://wuthering-waves-map.appsample.com/>Convene Trackerhttps://wuwatracker.com>EventsWHEN IN DOUBT, CHECK: https://wuwatracker.com/timeline[Through Verses and Rhythms - Ciaccona Banner] [May 22 - June 11][Woodland Aria - Ciaccona Weapon Banner] [May 22 - June 11][Anniversary Featured Reesonator/weapon Convene: Phase II] [May 22 - June 11][Gifts of Grand Reunion] [Apr 29 - Jun 10][Cubie Derby Warmup Anni Leisure event] [Apr 29 - Jun 10][Gilded Nightmarket Anni points event] [Apr 29 - Jun 10][Cube, Cubic n Cubie combat Anni event] [Apr 29 - Jun 10][Memory Travelogue photo Anni event] [Apr 29 - Jun 10][It's Carnevale Time! Anni Returnee Invitation event] [Apr 29 - Jun 10]>Timeline, Rewards and Media Contentshttps://rentry.org/wuwavgv2>Emoteshttps://mega.nz/folder/JoQTwJ6K#y0znR9hynrLTz8hvliNFughttps://drive.google.com/drive/folders/1n3hwVHMgw19dmeWG_EnbW3KVKQKvhcaJhttps://files.catbox.moe/49buge.zipaty0xtrg>/wuwa/ Friends Listhttps://docs.google.com/spreadsheets/d/1MzulbsusjOWpaFg6o6kk3TvCWfFYi6EF7NyJXqIazGo>NEWS/EVENTS (and patch notes)https://wutheringwaves.kurogames.com/en/main/news/detail/2329https://wutheringwaves.kurogames.com/en/main/news/detail/2302Previous:>>524748492
>>524833676Back to your containment board faggot.>>>/lgbt/
The genetic toilet of nations
>>210954031Do you know the sketch from /pol/ where this guy presents a sketch of boobs and underneath it is the the thread template for 4chan and the thread theme is "lust provoking image-time waisting question"?We should have a version that says "extravagantly provoking article title-emotional response illiciting question".
ALERT! ALL UNIONS REPORT IN! TEACHER UNION ULTRA HYPERCOLOR RAINBOW ALERT!I have a source who told me that certain changes to special education no longer mandate that all special education students possible be put into every class possible, but are segregated into two levels below 'classroom' and this will eliminate most IEPs for most students who will have to either step it up, go to retard school, or be put into actual "retarded" status officially (again).Certain electives which require undue facilitation for participation will also be cut. Many students in many areas these days, if they perform poorly enough, have a FULL TIME MINDER who sits next to them in class every single period for every single day, a paid full time paraprofessional. This has been boosted by free Fed bucks if you do it so it's very common now. Anyway that's all over now, the under-performers will have to shape up or ship out or literally be adjudicated to be actual retards on their permanent records.Not even memeing my source who I put my penis into had an emergency meeting TONIGHT with her colleagues when they found out about it.
One more thing, the critical thing really. The news was that this was going to hit every school in every state, and that it would hit the more wasteful places the hardest. Some talk was heard about the Department of Education taking over very underperforming places directly, Federally. Teachers were SHOOK tonight.Call one or ask one yourself if you know one. Tell them, 4chan sent you.
> Anime Hikikomori NEETs whose lives are in crisis like Satou are aged 22 to 28> I'm a 32 year old NEETGrim. Even Welcome to NHK is wish fulfillment for me
And here I am just working my office job posting on 4chan during the commutes.It's not just "total trainwreck loserfaggot" or "succesful with beautiful big tits wife". Some of us, probably most of us, are living extremely mediocre lives. But it's only over if you give up.
Society status?
>>710538708>Christcultists trying to recruit on 4chan
I don't even mind the lack of apostrophes but how am I supposed to take freetards seriously when they can't even spell the word "program"
AAAAAAH A MINOR TYPO I NEED TO MAKE A 4CHAN THREAD ABOUT THIS