• 0 Posts
  • 338 Comments
Joined 2 years ago
cake
Cake day: December 25th, 2023

help-circle


  • The problem is that this is one of the few use cases where I can afford the (dangerous and unreliable) cloud service but I’m far away from being able to do so self hosted.

    I’m actually using LLMs quote a lot to counter some of my brains more weird bugs working-as-intended features. But this is way beyond what I could locally do.

    For anyone in a similar shoe: you can mix local and remote quite well though, using local for everything that works out and remote for everything else. I.e speech to text and email analysis is done on my local server while bigger sets are done on the CLI with remote providers.


  • The problem is the other side:

    The seller has a huge interest to not deal with too much fiat exchange. There’s always fees and market risks associated.

    The USD historically was very stable compared to the rest. That in combination with the huge purchasing and military power the US represented while being reliable as a trading partner pushed the US dollar into focus.

    The USA then spent a lot of time, energy, money and lifes (mostly others) in ensuring this dominance.

    Think of it like a language: a Spanish and a German work together in English - not because it’s impossible for them to learn each others language but because the overhead is too big.

    Specifically to your example: no one wants to sell anything to Russia in rubles.

    Imagine this scenario:

    Hey, I’ll pay you 100 YC (your currency).

    Oh since we agreed on the price a few days ago it’s only worth 80YC.

    Oh now it’s 120 YC but no one else will take the currency I’m paying you in except me.

    Oh now it’s worth 10 YC but we signed the contract, hurray!!



  • This got way longer than expected but the tldr is: foreign exchange is super complex and depends on a lot of factors which don’t matter to you as money user. I tried to give a few examples below.

    Plus: You’re mixing up two very different concepts:

    Fiat evaluation and purchasing power.

    First, money;

    “More worth” is a natural instinct but doesn’t reflect how the money market works: it’s a question of how much of that money is in circulation as well for example:

    1107650 CHF Million 19396,90 USD Billion

    (Source tradingeconomics.com ).

    So while it’s the CHF is slightly over value when compared one to one the picture is different when you look at total money available. Then you look at production capacity, glue creation and supply and demand for those currencies. All of this will flow into the price.


    The minimum wage discussion is a completely different one: here you need to compare minimum wage to the purchasing power of the area you are looking at and take into consideration how the tax and financial situation changes to be able to compare it.

    There’s for example concept called big Mac index which is a crude way of showing the difference: how much does MacDonald’s charge for their bullshit? They are everywhere and quite good at finding a acceptable local price.

    If you want to dive deeper a key word to look for is the Gini Index with which the wealth distribution is quantified. I’m not good enough to explain it well though.


    Now for the colors: design of money is the job of the nations (or unions) main bank to decide usually. The US seem to have the creativity of a washed down rock while others are more creative.

    The Euro money for example is designed with guardrails by each member country but color, size and form are fixed and optimized to be easily recognized even with various visual impediments, which I personally really like.




  • In case you wanna give it a shot: I gave writing samples of myself from chat and emails to a self hosted LLM, telling it to extract the writing style deviations, key elements, common phrases, symbols, patterns, etc. Then gave that as a “answer it this style” system prompt expansion - works like … Quite okay. Still need to go over it or course but it doesn’t sound like marketing bullshit but conveys what I want.

    Completely agree with your general assessment though! They’re getting better but the marketing machinery is crazy in their claims.








  • I tried more “niche from a popular perspective”. You’re right, especially alpine is in the background of a lot of docker containers but rarely an end user who just want their desktop environment knows them.

    For nixos I’ve not yet seen anyone in the enterprise world pushing for it - there it’s still all about containerization and orchestration in cloud environments, using that as reproducibility layer. That might change though with data sovereignty discussions going on.


  • I can see where you’re coming from! Specifically this community though I’ve not seen it a lot - you’re completely right though, the more native one becomes the more one is confronted with it.

    I’m still struggling with the slowness of things (e.g. a quick endpoint change) and I can’t get my head around reason error messages “fluently”, i.e. I have to think about what the errors want to tell me instead of resolving it - a bit like old python stuff really.

    And then there are the edge cases … It took me a long time to change the config the very first time while offline - which makes sense from a model perspective but from my user brain it was just … wrong :D

    Perhaps I should switch my clients as well to get more exposure…



  • If you are truly serious: this is not how hallucinations work. It’s really best to think of it as “fancy auto complete”. The hallucinations happen when the next token is too disconnected from what we as humans would call as “belonging together”. But it’s all math after all.

    Limit the k value, tube down temperature and cut off context size and the issue of hallucinations is a non-topic for “transcribe and summarize”.

    You get into what I’d call “stupid” territory like you’re describing.


    Your second point I fully agree with and is the reason why I’d ask the doc directly. To give the personal anecdote: the transcript itself helps me to focus on exactly the topics you’ve described: who’s confused? Where was agreement? Where did people just not speak up?

    A specific hallucination example I see every other day for example are tasks: that thing “thinks” that “we should” or “you must” are always tasks and outcomes which is utter bullshit - but I know that and using the transcript part helps me focus on the important part, the humans.