Grilled Cheese

ExploreLog inSign up

Emily Riederer

@emilyriederer.bsky.social

4.2k Following9.5k Followers

Here for data, data science, analytics engineering, rstats, books

PostsRepliesMedia
@emilyriederer.bsky.socialOct 10, 2026, 10:42 PM

Percent calculated and reformatted as a string column while still in database *twitch* We know dashboards are bad because they pull business logic too far downstream So too here, we are pulling data display too far upstream Let numbers be numbers. You might even want to math with them. 60/

@emilyriederer.bsky.socialOct 10, 2026, 9:36 PM

Hmmm thanks for the good points, very fair! I buy the point that it's perhaps a more reasonable default than I gave it credit for, but I guess I'm just lazy and crave a bit more syntactic sugar for, e.g., exporting into partitions

@emilyriederer.bsky.socialOct 10, 2026, 1:07 PM

Increasingly, this is just becoming me complaining about GCP

But BigQuery exports to GCS create an absurd number of small fragments with few options to control **by design**

Why?

IMHO hard to justify speed >> coherent files in batch setting

discuss.google.dev/t/bigquery-e...

59/

Screenshot of answer about BigQuery exports on Google forum:

While it might seem counterintuitive, BigQuery prioritizes export speed by leveraging parallellism. This means it divides the data into smaller chunks to process concurrently, which inevitably leads to a larger number of files. The tradeoff is speed vs file count.
@emilyriederer.bsky.socialOct 10, 2026, 12:48 AM

Running a GCP job for which I clearly did not provision enough RAM and somehow filled with the same manager guilt of when you realize someone on your team is too stretched I’m sorry, computer. I did not enable you with the necessary tools to succeed here

@emilyriederer.bsky.socialOct 9, 2026, 9:31 AM

Fortunately the slides are very evocative!

@emilyriederer.bsky.socialOct 9, 2026, 9:06 AM

Sounds wonderful and really resonates! Will there be a recording?

@emilyriederer.bsky.socialOct 9, 2026, 12:20 AM

Absolutely bonkers, IMHO, that BigQuery table names are case sensitive by default O/C, everything uncontroversially is in R and python, but I feel that it's so anathema to the rest of SQL Just fixed a gnarly bug with `is_case_insensitive = FALSE` (after staring at the double neg for a bit) 58/

@emilyriederer.bsky.socialOct 8, 2026, 11:21 PM

Ever relevant (inspired by some segmentation logic): zip codes are rarely the most coherent for most purposes that are not mail delivery

carto.com/blog/zip-cod...

57/

@emilyriederer.bsky.socialOct 8, 2026, 12:41 PM

I previously used Connect! (That team still does; I just changed roles where it became less relevant) Happy to chat about it

@emilyriederer.bsky.socialOct 8, 2026, 12:29 PM

Bound to happen but you hate to see it: technical diagrams in GCP docs with the AI slop aesthetic. Historically, their dev docs have been *very* nice (much better than AWS imho) So compact, so saturated.. 56/

@noamross.netOct 7, 2026, 8:13 PMReposted by @emilyriederer.bsky.social

I'm speaking at the NYC Statistical Computing Meetup about @grantwitness.org: how we use modern #rstats stack to produce trustworthy, reproducible, rapid data that powers activism, litigation, and journalism.

Join us in-person @ NYU or online. Mon, Oct 19 at 7PM!

www.meetup.com/nyhackr/even... 🧪

@emilyriederer.bsky.socialOct 8, 2026, 2:33 AM

I regret to inform me they want more changes to this guy

One day I will find time to properly tear it down and build it back up

bsky.app/profile/emil...

55/

@emilyriederer.bsky.socialOct 8, 2026, 1:57 AM

In an icebreaker a few weeks ago, our team was sharing pet peeves and an early-20s said API 429 errors. Not API errors but specifically status code 429 (too many requests) and I'm still thinking about it If that somehow isn't a metaphor for early 20s exuberance.. your 30s are all 500s

@jtlg.bsky.socialOct 7, 2026, 12:46 AMReposted by @emilyriederer.bsky.social

It's the yellow-and-white cover of a Springer Graduate Texts in Mathematics, except the author is "OpenAI" and the title is "Understanding the Proofs is Left as an Exercise for the Reader"
@emilyriederer.bsky.socialOct 7, 2026, 12:54 AM

Reminding myself about this "get stuff done" piece as I resist the urge to refactor

Volunteering is great complement to day job because risk sloping between 'right' and 'fast' is quite different. Good to practice slow and fast twitch muscles

bsky.app/profile/emil...

54/

@emilyriederer.bsky.socialOct 7, 2026, 12:28 AM

MailChimp IMHO has always struck me as a product with so little SWE sensibility. From the janky email templates lacking any sort of control flow (it makes you **miss** Jinja!) and apparently all the way to the API Gotta pass text blobs to API instead of an ID like a sane person 53/

@emilyriederer.bsky.socialOct 7, 2026, 12:21 AM

😆

@emilyriederer.bsky.socialOct 6, 2026, 10:56 PM

Well if I ever need to remember what to write on a post it later, I’ll consider a sketchpad!

@emilyriederer.bsky.socialOct 6, 2026, 9:20 PM

Sometimes during the day I make a note on my PostIt note to-do list that is just to remind me to add something to my running Google Doc to-do list. This is either very organized or very chaotic and I’m not even sure which anymore

@emilyriederer.bsky.socialOct 6, 2026, 9:16 PM

Perhaps with undecideds 50 isn’t as relevant of a benchmark?

Older posts
Terms of UsePrivacy PolicyCommunity StandardsHelpGet the app

Grilled Cheese is a product of Village Compute

Version devBuilt at: 2026-10-12 04:31:30 EDT