Let’s say I wanted to run a full size open weight model. I have a 128GB m3 max laptop.
Does this basically load layers in and out on demand? So I still have to download the full model to disk, but the RAM requirements go way down? The readme calls out that one still needs to connect HuggingFace, which leads me to believe that maybe you don’t even need to download the full model?
If you point it at a huggingface model identifier, it will download it, I assume. No way around that.
It reads like it is keeping only the core and the active layer loaded at any one point, and streams layers from disk; there are several other solutions like this and if my understanding is right, this is probably better than an mmap implementation or just streaming experts in.
Not an expert in this field, but the "expert" is consisting of multiple layers. To keep it small in terms of memory print, this project streams each layer (dividing even further).
It also requires extra space because of decomposition of the layers. Normally the file format optimized for compute intense workloads. But here the bottleneck is the memory capacity.
Also guessing that you need to be able to hold at least 3-layers at once in the memory, given M x N = R operation, M is the previous layer, N is next, and R is the result. on the next "layer", the R (result) becomes M, gets computed against the next layer, N, yielding the further result R'. And so on, until all layers are processed.
I assume it's horribly slow, but can be put in a non-intrusive background task...
Religion provides certain benefits in the military. If you are say a Christian, you get assigned time to go to a (hopefully) air conditioned church and relax and recover. Even if it’s short, it can be beneficial to collect yourself in a high stress situation like basic training/boot camp.
If you elect not to go to a religious service, you typically have to keep doing whatever you are doing. Atheists or other less organized religions should be treated equally under the law. If a Christian gets a 90 minute religious service, an atheist should also get 90 minutes to do whatever they want.
You also see this reflected with something like The Satanic Temple advocating for human rights under the guise of religion.
In my opinion, religious organizations should not have any more rights or privileges than businesses.
This was true 20 years ago (not sure about now). As an atheist/agnostic in basic training I used to try different church services to get away from the barracks on Sundays. If you didn’t you were definitely assigned some cleaning detail instead of having down time. At the time it didn’t come across as discrimination and felt more like a way to keep control. At various times when control was lax bad stuff happened, e.g. fighting, sex, awol, etc. In a new light this does seem like it has a disparate impact.
I am curious how the variety of faith based practices could be handled…I’m super on board with providing a universal spiritual/mental health space regardless of your affiliation. That gets very weird when you start having to account for the variety of schedules and practices.
I am pretty sure I disagree on religious orgs having no more rights than a business. I think that seriously under accounts for the degree of identity that folks get from their religious affiliations and the types of activities businesses and religious groups tend to do.
A business and religious group are pretty fundamentally different…I’d have to reflect a lot longer and harder to come up with a more stable and coherent stance on that. I can definitely think of valid arguments on either side.
> I’m super on board with providing a universal spiritual/mental health space regardless of your affiliation.
This is what was happening in the Army's Chaplain Corps[1] prior to this administration: Seeking to emphasize and credential Chaplains as mental health specialists in an organization with a consistent track record of personnel with pervasive mental health problems.
It seems that has all been scrapped and we're going to fix mental health problems with "good ol' religion".
[1]: I can't speak for the other services but probably the same.
I guess my question is does it make sense for the US government to spend money providing church services for people who just want mental health benefits, and a break? I think believing a religion is very different from creating a religion so that you can maximize government benefits.
As somebody who works with data and humans, I know it's not a good idea to use the absence of information as information. Then you need confidence that the absence was on purpose, and means a specific thing. Whereas you could simply not omit the information.
It being a "list of religions" is just a semantic distraction, like saying "bald" shouldn't be on a list of hair colors.
Switched to this knot a few years back for any day when we're walking/hiking a lot. I also tie my children's shoes this way if they're having a struggling day.
If anyone's playing with this you may find that after you tie the loops together they're sitting funny; you basically have to swap the sides the loops sit on!
Along similar lines: many of your favorite authors, musicians, and creators have public email addresses and seem to love getting emails. I’ve started writing notes with my kids to their favorite authors with ideas and always a thank you note.
I’ve gotten replies from authors on NYT best sellers lists, musicians, and more.
I know some authors in particular never, ever want to be sent story ideas. The potential of being accused of or sued for plagiarism down the track for something even vaguely similar is non-zero.
Ironically, I've found the best way to engage with creators is their YouTube channels. They're incentivized to engage by the algorithm, so if you can land a thoughtful comment early so they don't have to wade through 500 comments to see it the odds you'll get a short reply or a heart are pretty good.
Hah, I know the feeling. I installed Ubuntu on a PC recently, it obviously happened to be one of the days they got DDOSed and apt repos were unreachable. I had other things to take care of, so I put it aside for the next week or so. It didn't help very much, cause after picking it back up, halfway through, Snapcraft went down.
I vibe coded a script that interacts with both Gitlab and Github via their APIs and I've been using it pretty heavily since this morning. I crossed the streams! Goodness, I didn't know it would be _this_ bad!
Post College friendships can be hard. Friendships before graduations are almost all completely spontaneous and natural. No one has to _really_ know how to be the initiator. My experience suggests that it doesn’t really get better as you age, either.
My wife and I took on that role after college. Neither of us is particularly outgoing, but we’re not cripplingly shy either.
Meeting new people is about realizing you’re not alone in feeling lonely. When we pick up on positive vibes we just ask for a phone number “can I have your phone number? You seem cool, and I’d love to ___. (Fill in the blank with one of “get a cup of coffee/beer”, “take a walk,” “invite you to a [thing I host].” It’s not significantly different from the dating scene except it’s so much lower stakes. I recommend sticking to same sex or group invites for this reason. Rejections are rare, and almost certainly don’t reflect on you.
Secondly we start things on schedules. Things that happen regularly are super low pressure ways to start friendships: “hey, we cook an elaborate dinner and then hang out and play instruments/sing/watch a movie/hang out at the beach/take a hike once a month/week/whatever, join us!”
This makes it easy to invite anyone without it feeling like a date.
I say all this knowing that none of this is _easy_, but it is a kindness. You’re not alone feeling lonely. With a little bravery you can totally be the person who makes it better for your new group of friends.
> Friendships before graduations are almost all completely spontaneous and natural.
They are mainly from proximity. You see people in class, you live near them, and you're near the same age. It's the same reason in person work would generate friendships/relationships. The challenge in today's remote world is proximity now has to be intentional.
According to Google some 20% of marriages began at work, and some 50% of people say they have a close friend at work. IDK about it being a primary source, but it's definitely an important one. And it makes sense when people are around each other all day.
