Hackathon - Summer 2023
Using Tukey's Fences against the First Derivative of the data to detect sudden changes in value

Hackathon - Summer 2023

Just finished my real "proper" #hackathon project at Mountain Warehouse.

I did a mini one a couple of years back looking at mesh networking with Raspberry Pi with the retail team lead at the time. But that was a more like individual research as the two of us were working on operational things in parallel. And on the other there had been time critical projects to finish such as helping launch the MW Marketplace so I didn't have a chance to join other sessions.

So this time, I made sure that I could dedicate time to joining a project. I also had a project idea to pitch.

Investigate techniques and visualisation of data to identify sudden changes and outliers.

The reason for the interest in outliers is that they often tell us where something is going very wrong, or very right. For example if you make a sale where someone spends a lot of money, it can be useful to know why they did that so you can reproduce it. Or looking at the weights of products (which we need to predict shipping costs), if one pair of boots came in at 20Kg or 20g then that would indicate incorrect data as we could investigate it and correct it.

My team investigated some different algorithms; Tukey's Fences, Z-Scores and Hampel's Identifier. And we put some of those into a simple Blazor app for visualisation using the Plotly.js and the Blazor wrapper for that Plotly.Blazor. As a technical exercise it was a success in that we successfully identifier outliers and visualised them. But it was also a success as a team event with much more collaboration than my previous hackathon and also more than many "team building" events I've been on.

No alt text provided for this image
Identifying outliers in product weight data

The presentation went well with the demo app acting both as the narrative and the content. There were also some great projects from other teams. Tools for managing errored RabbitMQ messages, a prototype web store in NextJS, a feedback application, application metrics using OpenTelemetry, Predictive modelling using ML and of course an OpenAI project.

And there was great evidence of both creativity and collaboration from all teams. Lots of people left the presentation with ideas they could take back to their own applications and projects. And it was a big boost to team motivation. So all in all, I think it was a successful event.

A massive thanks to Phil Sharpe for co-coordinating and to Mountain Warehouse for allowing us time to develop our skills both technically and as a team.


Chitra Adhikary

Agile Technical Program Manager | Delivery Management | Marketplace | Agile Evangelist | Product Management | ex SDET

1 年

Sounds lot of fun??

Raksha Choudhary

.NET Developer at Mountain Warehouse

1 年

It was really a good hackathon...

回复

要查看或添加评论,请登录

Andy Clark的更多文章

  • Jules May - Extreme Reliability

    Jules May - Extreme Reliability

    Some of my colleagues attendee a session with Jules May at SDD the other week. I'd seen him speak on previous years and…

  • First Year at Mountain Warehouse

    First Year at Mountain Warehouse

    Just over a year ago, I joined the development team at Mountain Warehouse. It was a bit of a strange start as I was one…

  • gRPC and Polly

    gRPC and Polly

    This week I attended a session with Mark Rendle at the NDC Manchester. We were looking at gRPC, my interest is to see…

  • When is a PDF not a PDF?

    When is a PDF not a PDF?

    Something I spotted earlier in the year when preparing my CV is that what you see is not always what you get. I spotted…

  • Tai Chi, Dragons, Snaps and Yak Shaving

    Tai Chi, Dragons, Snaps and Yak Shaving

    I started up with a Tai Chi class back in January and was just getting into the swing of things when the country went…

  • Under-performing team members?

    Under-performing team members?

    "What would you do about underperforming team members?" I was asked. "Sack their manager" was my first thought.

  • Thoughts on Primary keys for relational databases

    Thoughts on Primary keys for relational databases

    What kind of key fits no lock? A primary key. - Grant Fritchey Grant shared a comment on Twitter yesterday about…

  • Chaos and Distributed Systems

    Chaos and Distributed Systems

    Yesterday I was very privileged to attend a meetup of the London Chaos and Resilience Engineering Community hosted at…

    1 条评论
  • Tables are not queues

    Tables are not queues

    Was looking at an issue where tasks that needed to be executed were being executed more than once. It was tracked to…

    1 条评论
  • Different ways of developing enterprise software

    Different ways of developing enterprise software

    Software is a great way to automate and standardise many business processes. And depending on the size of your business…

社区洞察

其他会员也浏览了