Archive for the ‘OpenSource’ Category



Project Harbor is an open source trusted cloud native registry project that stores, signs, and scans content. Harbor extends the open source Docker Distribution by adding the functionalities usually required by users such as security, identity and management.

The open source project Harbor Bosh Release (https://github.com/vmware/harbor-boshrelease) aims to create the Bosh release for Harbor and deploy it in Open Source Cloud Foundry. This session will introduce the techniques and good practices used in the Harbor Bosh release, specifically for running the Docker container registry server.

PDF: Using BOSH to Deploy the Open Source Harbor Docker Registry


Read Full Post »

As a code committer for Open Source Project Chef, I attended the 2nd Opscode Community Summit 2012 on October 23 & 24 in Seattle, WA.  Here is my notes for this summit.


  • about 100 persons attended this summit
  • a few SMB company and startups attended this summit, learning Chef and sharing achievements/techniques/questions with the community, including Opscode, CloudScaling, DreamHost, Blue Box, HP, Google,  Adobe, ThoughtWorks, Workday, LivingSocial, Qualcomm, Mopub, Nordstrom, OneHealth, Wikia, Fidelity, Heavy Water, thePlatform, etc.


  • about 46 one-hour sessions are hold (see session ; about 10~15 attendees for each session; Opscode holds about 1/3 sessions while Dreamhost, CloudScaling and others hold other sessions.
  • I hold one session ‘How VMware Serengeti uses Chef to Provision a Hadoop Cluster in a vSphere Cloud’, for introducing Serengeti, Ironfan and Chef techniques used in Serengeti.  Luckily about 6 persons are interested in my session.  They’re interested in:
    • architecture of Serengeti Ironfan?
    • what’s special in Hadoop and vSphere?
    • can Hadoop ran well in vSphere as in physical hosts?
    • any benchmarking?
  • Some hot topics
    • Chef Orchestration Layer (such as Ironfan)
    • Bare Metal Provisioning Tool (such as Razor from EMC + PuppetLabs, FAI)
    • Windows support of Chef
    • Chef Driven Monitoring and Metrics (e.g. Nagios)
    • TDD for writing Chef Cookbooks
    • Cookbook versioning
    • Chef Knife plugins for OpenStack and EC2
    • etc.


Serengeti and HVE

  • A Opscode Sales Manager is very interested in Serengeti and HVE, and told me that almost all their customers who runs hadoop are running it on physical machines rather than virtual machines.
  • She cares about the performance comparison of Hadoop+HVE on vSphere and Hadoop on physical hosts.
  • A CTO of a startup in Silicon Valley shows strong interests of Serengeti/Hadoop and Ironfan.


  • Ironfan/Infochimps has good reputation in Chef world (although there are a few people are not familiar with it)
  • Ironfan does a good job as Chef Orchestration tool. In the session ‘Chef Orchestration Layer’, users are eager to find an powerful Chef Orchestration layer, and find a solution to manager Chef nodes, control the bootstrapping workflow, handle cluster service dependency to resolve racing condition.   I introduced the appoach used in Serengeti and are well received.
  • seems there is no other orchestration tools (I only heard 2 tool in this summit) better than Ironfan in Chef world.


  • EMC and PuppetLab’s Project Razor (released in May 2012) can do physical and virtual hardware provisioning and software provisioning. Razor is open sourced under the Apache 2.0 and is fully compatible with both Puppet open source and Puppet Enterprise.
  • Some SMB and startups are using Physical Hosts + Chef to provision their infrastructure (such as Wikia)

Data Director

  • Fidelity uses a software for provisioning mysql and postgresql db (but not Oracle), sounds like very similar to Data Director. Maybe Fidelity company can become a potential customer of DD.


  • Talked with Chef creator and Opscode co-founder Adam Jacob about adding a  rollback feature (CHEF-3502) into Chef.
  • Talked with the organizer of Opscode Community Summit 2012 (also the Opscode co-founder) Jessie Robbins about Serengeti.
  • Talked with Joshua Timberman (Opscode Technical Community Manager) about adding a new feature (CHEF-3571) into Chef, and we are collaborating on driving the feature into next version of Chef.
  • etc.

Thanks very much!

Read Full Post »