Keqiu Hu

Posts by Keqiu Hu

  • graph-of-linkedin-cluster-trends-for-hdfs-space-used-total-name-node-objects-and-yarn-compute-capacity

    Scaling LinkedIn's Hadoop YARN cluster beyond 10,000 nodes

    September 8, 2021

    Co-authors: Keqiu Hu, Jonathan Hung, Haibo Chen, and Sriram Rao At LinkedIn, we use Hadoop as our backbone for big data analytics and machine learning. With an exponentially growing data volume, and the company heavily investing in machine learning and data science, we have been doubling our cluster size year over year to match the compute workload growth. Our...

  • diagram-of-how-tony-works-with-horovod

    TonY joins LF AI & Data Foundation

    July 15, 2021

    Co-authors: Keqiu Hu, Jonathan Hung, and Junfan Zhang Today, TonY is joining the LF AI & Data Foundation, an umbrella foundation of the Linux Foundation supporting open source innovation in artificial intelligence, machine learning, and deep learning. “We’re thrilled to welcome TonY into incubation in LF AI & Data. The project offers functionalities that are not...

  • bluepill1

    Open Sourcing Bluepill: Run iOS Tests in Multiple Simulators

    January 18, 2017

    Testing is a key component of LinkedIn’s 3x3 strategy. As we continue improving our iOS continuous delivery pipeline, we are faced with two major obstacles—tooling stability and scalability. We needed a tool to run iOS UI tests both reliably and quickly. For this reason, we created a project, called Bluepill, that we are open sourcing today. Bluepill is a...

  • 3x3: iOS Build Speed and Stability

    April 7, 2016

    At the beginning of last year, alongside the development of Project Voyager, LinkedIn’s new flagship mobile application, we started...

  • Test Stability - How We Make UI Tests Stable

    Test Stability - How We Make UI Tests Stable

    December 16, 2015

    If you know anything about building user interfaces (UI), you probably know that it's very difficult to test them using automated...