“I forgot that every little action of the common day makes or unmakes character,” Oscar Wilde wrote in De Profundis

went into a rabbit hole into nvidia software.

• nvidia nim: apis to run llm models
• nvidia NeMo
  • curator: scalable data pre processing and curation toolkit for LLMs
  • customizer
  • evaluator
  • retriever
  • guardrails: toolkit for easily adding programmable guardrails to LLM-based conversational systems.
  • framework
• TensorRT-LLM: python api to define llms and build TensorRT engines that contain state-of-the-optimizes inference efficiently on NVIDIA GPUs.
• RAPIDS: GPU accelerated data science/analytics via open source software libraries and APIs.
  • cuGraph: accelerated graph analytics

also did a bit of reading into graph neural networks.

main takeaway is you can create a graph structure from text and images, but it's more useful for heterogeneous structures where the number of neighbors for each node in a graph is variable (as apposed to fixed for text and images).

there are three main predictive tasks for GNNs

(1) graph-level

• ex: molecule as a graph, predict its smell or probability of binding to a receptor
• analogy for image: classify an entire image
• analogy for text: label sentiment of an entire sentence

(2) node-level

• ex: predict identity/role of each node
• analogy for image: image segmentation
• analogy for text: parts-of-speech

(3) edge-level

• ex: image scene understanding, given nodes that represent objects in an image, predict which of these nodes share an edge or what the value of the edge is

the challenges of graphs in ML: representing graphs for neural networks

graphs have 4 types of info

1. nodes
2. edges
3. global-context
4. connectivity (hard part)

first three is straightforward, we create a node matrix N, where each node has an index i that stores the feature for node_i

connectivity is more complicated. first, adjacency matrix are sparse and space inefficient. second, many adjacency matrices can encode the same information, but without a guarantee that they produce the same result (they are not permutation invariant)

solution: represent sparse matrices as adjacency list

they describe connectivity of edge e_k between nodes n_i and n_j as a tuple (i, j) in the kth entry of the list.

conceptual

• A Gentle Introduction to Graph Neural Networks
• Understanding Convolutions on Graphs

applied

• Introduction to Graph Neural Networks with NVIDIA cuGraph-DGL | NVIDIA Technical Blog

found these datasets to work with

• Open Graph Benchmark | A collection of benchmark datasets, data-loaders and evaluators for graph machine learning in PyTorch.
• Yelp Dataset

chinatown stockton street

For a man's ways are before the eyes of the Lord, and he ponders all his paths – Proverbs 5:21 ESV

methodist church chinese service, they're so hospitable and welcoming. they keep saying "so glad to see young people". played ping pong after service. they had sticky rice and che thai.

space X chopsticks capture

italian heritage festival & parade

saw blue angels at fisherman's wharf. they fly down to 18 inches apart from each other. and costs ~120 mil each. the booming sounds they make are both terrifying yet thrilling at the same time.

went for a quick grocery run before the stores closes at 6pm. did a photography walk around chinatown. so impressed by the x100s, the only thing is the pictures that come out of it is dark, and requires lightroom for post-processing. but for a camera that came out 14 years ago, it's working so well.

so many things happening in the world. i'm only experiencing a tiny slice of it.

felt immensely tired today. is this the tiredness from the past week catching up on me? what is considered rest? am i even capable of rest?

A quiet secluded life in the country, with the possibility of being useful to people to whom it is easy to do good, and who are not accustomed to have it done to them; then work which one hopes may be of some use; then rest, nature, books, music, love for one's neighbor — such is my idea of happiness. — Leo Tolstoy

basketball and bbq with IEC friends

talked about giving parents money as a culture in chinese families

napped for 2 hours

woke up feeling confused

final group assignment for regression

staked 0.02 ETH for ETHGlobal hackathon, excited to jump into web3 and see what i can build.

a few good resources

• Ethereum Developer Resources | ethereum.org
• useWeb3.xyz · Learn Web3 development
• Speed Run Ethereum

Omedetou: celebrate the small wins

highlights from fall mod 1

• sf systems
• went to google office for ollama meetup
• visited salesforce park (it's a nice place to stroll after lunch)
• waterloo house cooling party (saw a nuclear fusor in person + twitter people)
• went to playspace and presented to 30+ people
• traded for aerogel
• looted free stuff from a group house
• malaysian independence party with singaporeans
• went to a comedy show in a bar
• picked up trash in mission
• bought nectar bed and set it up
• started papertrail
• ai devtools hackathon best demo w agentops
• practicum meet n greet (kevala & meta)
• meta interview grind
• got meta with chinatown boys
• transamerica park ping pong
• haidilao in fremont with old and new friends
• kbbq and karaoke with the boys
• built aha and presented at class
• first book club – user friendly
• visited a presbyterian church
• ray summit
• cooked japanese beef curry
• took the hardest exam in my life
• gym'ed 18 times, currently squat 135lbs (but causes soreness in lower back) and curl 40 lbs.

two lessons from aging is another word for living by rosie spinks that i want to take into the rest of the program

lesson #11: find 25 minutes

If you think you don’t have time for hobbies, writing, fitness, reading, gardening, it’s because you’re looking for hours. Look for 25 minutes, a few times a week. That’s all you need. The first five minutes for faffing about, the next 20 are for doing the thing.

lesson #13: relish life at your busiest

There is a state of being where you are hyper-functioning, pathologically getting things done, thinking that once you tick off every last thing, you will finally get to all the good stuff. It’s possible to spend your entire life in this mode, promising yourself you’ll enjoy it all once you get to the other side. The other option is to accept there is no other side. To realize that the assignment is not to get everything done perfectly, it’s to find ways to relish life even (especially) when you’re the busiest. I will never not be re-learning this lesson, but Oliver Burkeman’s essay on adopting a “deliberate defiance toward the inner taskmaster” has really kept it front and center in my mind this year.

presenting aha was fun. I was told i was comfortable in front of everyone which is a first. seems like i'm getting better at presenting. never felt nervous but my heart was beating faster and faster uncontrollably that i was losing my breath towards the end. still need to work on a confident voice. i sound like a high school kid that's still not sure about himself, like that kid from yiyi. i do not look or sound ~23.

was so tense and stressed from morning till 3:30. one of the most intense 2 hours and 10 minutes (extra time) of my life. i probably got 20-30% of it wrong, or even more, but i'm glad i got everything done. i was so close to leaving two questions blank, but i powered through, and was able to write down a proof that was sensible.

i realized solving these problems require persistence, they're never obvious from the start, and it requires some thought, it's so easy to give up early on and say "i can't do it". i think i've wired to give up quickly without being patient enough with a problem. i think if you just keep chipping away on the problem, you can get somewhere, and with a bit of luck, and sound intuition, and solid math, you just might reach the end.

i'm also realizing that math skills is so crucial, and i shouldn't skimp on math knowledge, even though i enjoy building and prototyping a lot more. i should put my stats degree to good use, double down on hard math and stats, understand the foundational stuff, because it will pay off in the future when i'm solving harder problems that require deep knowledge.

researched into Hume, a series B startup that launched a foundational audio-language model – EVI 2 that integrates empathetic AI into any product

how does the models work? it captures patterns from our speech and face:

• Facial Expression
• Speech Prosody (the way you say words)
• Vocal Bursts (sighs, laughs, oohs, ahhs, umms, and shrieks)
• Emotional Language (the words we say - explicit disclosure of emotion and implicit emotional connotation)

these reveal our preferences – whether we find things interesting or boring, funny or dubious, satisfying or frustrating, and and learns from these signals.

they call it RLHE - reinforcement learning from human expression.

these models trained with RLHE can serve as better copywriters, call center agents, tutors, etc, even in text-only interfaces.

their goal: a future in which technology draws on an understanding of human emotional expression to better serve human goals

they released the first concrete ethical guidelines for empathetic AI : Hume Initiative

they also publish their research

they have an ai engineer + writer role that caught my attention

here's the job description

We are looking for an engineer and writer to help copyedit developer materials (API documentation, tutorials) and write broad-reaching technical content (blog posts, white papers). In this role, you will create content that helps developers understand the role of emotional intelligence in AI, imagine the future of AI interfaces, and integrate our API into wide-ranging applications. You will work closely with our developer relations, product, engineering, and research teams on a diverse range of content.

The ideal candidate is a philosophically minded software developer with excellent writing and storytelling skills. They have worked with (but not necessarily written) API documentation, especially for AI tools, have informed opinions about the future of AI, and have a strong interest in science.

currently thinking of building an ios app where you talk to it throughout your day, and it summarizes your thoughts + tags your emotions with hume.ai, something like this tweet

a dump of my plan + notes for studying for my finals for a class that i should be doing well but is not because i'm just not good at math and stats apparently. might be the most i've studied for a class ever in my life

go through

• notes
• hw
• quizzes
• pq1, q1
• pq2, q2
• pfinals

prediction

• distribution of SSE (sigma_hat)
• e(sse)
• show y_hat independent to residual
• distribution of beta_hat
• log reg why use logit? issues with linear model
• explain what hii is?
• why 0 < hii < 1
• what is stud(ei)?
• press

Outliers

• outlier in x: leverage (hii) > 3p/n
• outlier in y: discrepancy (studentized e) > t (n-1-p), 1-a/2 (outlier in
• both: influence (cooks distance) >4/n

multicollinearity

problems: inflated SE checks:

1. swing/change sign coefficients in f-test
2. correlation matrix
3. VIF

solution

1. drop
2. feature engineer
3. regularized regression
4. dimensionality reduction
5. partial least square

heteroskedasticity

• unbiased

detection

• residual plot

problem: no longer BLEU -> wrong SE(beta) and CI/PI widths solution

1. log / square
2. boxcox
3. robust SE
4. WLS

if ei is non linear, use nonparametric regression (knn, moving average)

non-normal

• still BLEU
• no inference,

detection

• histogram
• qq plot
• test for normality: shapiro

for normal: skewness: 0 (third moment) kurtosis: 3 (fourth moment)

• omnibus k2 test (want high p-value to reject)
• JB test

problems: unreliable t.test, wrong CI/PI

false assumption of linearity

• transform y -> may introduce hetero if homo
• transform x -> nice when only prob is non-linearity
• transform both

Model selection under: biased coefs + predictions (under/overstimate), overestimate sigma2

extra vars: unbiased, MSE has fewer degrees, wider CI and lower power

over(multicol): inflated SE for coefs, rank deficient

adjusted R 1 - MSE / SST = 1 - SSE / n-p / SST / n-1 takes into account the "cost" of losing DF

Mallows Cp

• identify subset where Cp is near k+1 where k is no of preds
• this means bias is small
• if all not near, missing predictor
• if a number of them, choose model with smallest

AIC, BIC

• estimates infomation lost in a model
• trade-off goodness in fit vs simplicity, penalized by no. of model params (p)
• larger penalty term in BIC than AIC : ln(n)p vs 2p

PRESS

• modified SEE, uses predicted value for ith obs from model fit on data excluding that point

Because of the routines we follow, we often forget that life is an ongoing adventure...and the sooner we realize that, the quicker we will be able to treat life as art: to bring all our energies to each encounter, to remain flexible enough to notice and admit when what we expected to happen did not happen. We need to remember that we are created creative and can invent new scenarios as frequently as they are needed.

– Maya Angelou

went to a grammarly fireside chat with a few directors in their data org

what you look for when hiring

• base technical skills: sql, python, data manipulation (least important)
• is this person going to make our business successful? is grammarly going to grow the user base, make money
• people who understand business problems, can frame problems and solve them, has applied acumen
• create experiments that can drive business

recommendations for early data career

• find right mentors, strong set of leaders and peers, that will teach you more than anything else
• exposure to multiple aspects of problem solving, not just technical stuff, but cross-collaborate with stakeholders, how to report status, how to link your output with business impact, communication skills
• look into the tech stack of the company, work on the latest stuff
• company size, startup vs large company? structure is important

day2day for new hire on data platforms

• ingestion side, infra to bring data in
• data governance, compliance
• data eng: data modeling, transformations
• analytics & ML: data cleanliness and quality and availability
• everyone is a strong SWE, systems engineer (infra), data engineer (DE)
• strong generalist SWE
• databricks

big vs small company

• think about impact vs prestige
• big: prestige (name brand + density of talent)
  • mentoring on best practices, how to function these huge machines
• small: impact
  • have stories that your work directly move X millions of revenue
• find a company that can give you impact (bullet points on resume) + prestige

role of data science evolving (skills?)

• understanding the business context, the space you're working in, the elements you need to solve that
• less on fundamentals of the models, more on the application
• foundational statistics and knowledge intuition
• when things don't go well, really understanding exp design, causality, foundations of statistics will matter the most

AI companies

• robust system to measure quality of AI, human eval, responsible AI metrics
• subject matter experts on staff, people that can inform the models, everything that AI does is informed by human choices, who is making the choices?
• what does the data infra look like? is that company investing in the data? serious test on companies investment on AI

most innovative + impactful project

• orchestration framework for potential accounts to reach out to for sales team (ml, experimentation, llms to produce content)
• 50b events a day, making informed decisions from this
• suggestion quality, what is quality?

grammarly in llm era

• huge advantage in user context across different services
• lots of potential to innovate, supercharged efforts
• creates interesting data for feedback mechanism for marketing

some interesting work i encountered on their engineering blog

• CoEdIT: State-of-the-Art Text Editing With Fewer Parameters | Grammarly
• Measuring Marketing Effectiveness in a Cookie-Less World | Grammarly

migraine was back in the morning and i couldn't do anything at all in the morning besides cook lunch. acetaminophen kicked in 3 hours after i took it at 11am and i could finally function for most of today. pretty cool that i got to meet alumnis from cohort 11. when i graduate, i'll be meeting future students too. and i'll be saying the same things and giving them advice.

"Nothing is absolute. Everything changes, everything moves, everything revolves, everything flies and goes away." – Frida Kahlo

i had really bad migraine today again. where i just feel really nauseous and dizzy. i walk slower. i'm perpetually thirsty. i feel sick down to my bones. when i try to focus on something, i can feel my brain compressing. not really sure why this is happening. it's been like this since i readjusted my braces. it's probably that. i was told by my nurse it should be better this time though. hope this won't last for another 16.5 months.

my productivity and overall output is dramatically decreased. this is not ideal, especially during finals week. i'm only 22 about to turn 23. i shouldn't be this tired everyday, getting headaches and feeling sick often. there are old people in their 70s that have more energy than me. the elderly in church have more youthful energy. what can i do to feel better. maybe it's sleep. i need to get 8 hours. i've been getting 6 these days. time for bed. nothing is going into my brain today.

went back to the presbyterian church for their special combined service. cantonese church services are fun. i like it when i get to learn both chinese/cantonese and about the bible at the same time.

main takeaway from the sermon is to reflect on the authenticity of my faith. to not just say yes on my lips, but do another thing. that i should examine my heart and not my actions. God's grace is extended to all and this grace transform our hearts and mind, and that faith without action is DEAD (James 2:17), but by true faith, actions and good works ensue.

they had so much food. had conversations with old people. talked about malaysia and different cultures with food. talked about the pains you get when you start getting older. the members here have known each other for decades, and it made me miss home. i realize I won't get to experience growing old with a church, if I do achieve my dreams, and immigrate, then I'll be moving from church to church, it made me think about where i'll grow roots, and where I'll be settling down in the future, and how that shapes my life as i grow older.

weather was so hot it was worse than malaysia. so glad it's getting colder from now. really made me appreciate the fact that i'm in SF and weather is basically perfect. and how much weather affects well-being.

tried to study but kept context switching between paper trail, and the ray embeddings project, and fixing regression homework, and other stuff.

can't wait for finals to be over. studying for exam is one of the most time-consuming, stress-inducing, mentally exhaustive tasks, with little ROI depending on how you learn and how the exams are structured. I suppose you learn the value of deep understanding of concepts, and having high precision in your responses, and being able to perform under pressure.

decided to rewatch meet joe black for the 3rd or 4th time? a 3 hour movie that's slow, but has beautiful writing and score. you feel a lot of the emotions of the characters. they have this coffee shop scene that i really like.

a few thoughts

• prime brad pitt and his blonde hair style
• claire forlani's eyes and sophistication
• anthony hopkins' presence and authority throughout the movie
• the way he describes about his wife
• joe and his obsession with peanut butter
• the jamaican woman in the hospital
• “eryting goin to be irie now”
• claire's realization of who joe is while they're hugging each other at the party
• death and taxes
• him saying goodbye to his daughter

many more thoughts but its late. overall this movie made me think about how mysterious life is, and the shortness of it. how all your achievements and work and material gains all reduce down to nothing but the relationships that you have and the kindness that you've shown to others and the good work that you've done.

to live a long, peaceful life, to have experienced love, to have worked hard and suffer to build a legacy, to go through the ups and downs with family and friends, to be so lucky where you can wake up one day and say "I don't want anything more". that is true happiness.

some quotes

Joe Black: I don't care Bill. I love her.
William Parrish: How perfect for you - to take whatever you want because it pleases you. That's not love.
Joe Black: Then what is it?
William Parrish: Some aimless infatuation which, for the moment, you feel like indulging - it's missing everything that matters.
Joe Black: Which is what?
William Parrish: Trust, responsibility, taking the weight for your choices and feelings, and spending the rest of your life living up to them. And above all, not hurting the object of your love.
Joe Black: So that's what love is according to William Parrish?
William Parrish: Multiply it by infinity, and take it to the depth of forever, and you will still have barely a glimpse of what I'm talking about.
Joe Black: Those were my words.
William Parrish: They're mine now.

William Parrish: Love is passion, obsession, someone you can't live without. I say, fall head over heels. Find someone you can love like crazy and who will love you the same way back. How do you find him? Well, you forget your head, and you listen to your heart. And I'm not hearing any heart. Cause the truth is, honey, there's no sense living your life without this. To make the journey and not fall deeply in love, well, you haven't lived a life at all. But you have to try, cause if you haven't tried, you haven't lived.

William Parrish: Yeah, I certainly hope so. Yeah. I loved Susan from the moment she was born, and I love her now and every minute in between. And what I dream of is a man who will discover her, and that she will discover a man who will love her, who is worthy of her, who is of this world, of this time, and has the grace, compassion and fortitude to walk beside her as she makes her way through this beautiful thing called life.

Jamaican Woman: It nice it happen to you. Like you come to the island and had a holiday. Sun didn't burn you red-red, just brown. You sleep and no mosquito eat you. But the truth is, it bound to happen if you stay long enough. So take that nice picture you got in your head home with you, but don't be fooled. We lonely here mostly too. If we lucky, maybe, we got some nice pictures to take with us

William Parrish: I thought I was going to sneak away tonight. What a glorious night. Every face I see is a memory. It may not be a perfectly perfect memory. Sometimes we had our ups and downs. But we're all together, and you're mine for a night. And I'm going to break precedent and tell you my one candle wish: that you would have a life as lucky as mine, where you can wake up one morning and say, "I don't want anything more." Sixty-five years. Don't they go by in a blink?

William Parrish: It's hard to let go, isn't it?
Joe Black: Yes it is, Bill.
William Parrish: And that's life... what can I tell you.