Top of Page


Links to move inside this page.

  1. HOME
  2. IIJ’s data centers
  3. Data center archives
  4. History of IIJ’s data center technology development

History of IIJ’s data center technology development

1992 Birth of IIJ

IIJ was established in 1992 as Japan’s first ISP (Internet service provider).

To set up a Japan-wide Internet backbone, the company leased data centers across the country and built NOCs (network operations centers).

Data centers with NOCs can connect directly to the IIJ backbone, Japan’s largest, providing a highly accommodating environment for sites requiring broadband Internet connections. In 1995, the company launched housing and hosting services for such sites.

1998 Launch of wide-area LAN services

Moving into the latter half of the 1990s, IIJ gained recognition for the high quality of its system building and operations, and it gradually began taking on corporate systems projects. In 1998, we established Crosswave Communications Inc. (CWC, divested to NTT Communications in December 2003) to provide corporate WAN lines, and began providing wide-area LAN services (Layer 2 WAN services).

A wide-area LAN service connects users directly to a WAN via Ethernet, with billing based on the number of ports and irrespective of distance. Telecommunications carriers these days provide wide-area Ethernet services, but IIJ’s service was an astounding offer for companies at the time because back then the norm was to build WANs using high-speed digital leased lines with billing based on distance.

As CWC’s sales expanded rapidly, the company was in need of stations across Japan to expand its own network. At the time, we used large storage containers to build these stations without incurring heavy costs. Even back then, we knew that containers would prove useful for setting up 24/7 network equipment. And even after CWC left the IIJ Group in 2003, some of our engineers still wondered whether we could make use of this setup for data centers, and thus IIJ’s data center development team continued to pursue research on this topic.

Late 1990s Cloud services in their infancy and NHN

Another big shift happened in the late 90s. Once server-side Java and ASP became available and the infrastructure for connecting to databases and processing payments online was in place, the construction of e-commerce sites using dynamic site features became commonplace.

The system architecture of e-commerce sites is similar across different customers’ sites. Arranging the required equipment lineup and organizing it into components ahead of time therefore makes it possible to have the right combination of components ready to go when a customer orders a site, resulting in efficiency gains. It was with this in mind that we created the resource-on-demand service IBPS, the predecessor to our current IIJ GIO cloud service. With this setup, customers can use the resources they need when they need them, and cancel resources when they are no longer required. The customer need not bear the risk of asset ownership. IBPS was an example of what we now call IaaS.

IIJ also operates and manages large-scale service facilities providing the infrastructure for numerous services.

To reduce the cost of managing and operating these facilities, IIJ continued to pursue standardization and automation and created a next-generation service infrastructure technology it calls NHN (Next Host Network).(Japanese text only.)

Over the course of more than a decade leading up to the launch of the IIJ GIO cloud service in 2009, IIJ overcame a range of challenges in the process of evolving its IaaS business and service infrastructure. These included the use of virtualization, provisioning systems, in-house monitoring systems, and large-scale upgrades of servers, networks, and storage facilities. The company also came to understand that reducing the cost of data center facilities and power usage would be the most effective means of making IIJ GIO even more cost competitive.

2000s From water cooling to outside-air cooling

The data center development team’s research on containers continued.

As IIJ’s services expanded, it became clear that we would be unable to keep up with the speed of large-scale capital investment if we relied on urban data centers alone.

Increases in IT equipment power consumption and the resulting increases in air-conditioning system power consumption were also predicted to become a society-wide problem.

We therefore continued our research on containers with water-cooling systems, which were at the time said to be efficient, but we discovered that the capital investment and operating costs would not come down as much as we had expected. Meanwhile, outside-air cooling was already known to be an efficient cooling method, but there were no cases of it being used on a data center in Japan as the main year-round cooling mode due to structural problems associated with buildings and other factors. A study in the US, however, revealed that some data centers had begun to use outside air as their main cooling medium, and this prompted a major change of tack toward outside-air cooling at IIJ in pursuit of significant reductions in power consumption.

Yet we had nothing to refer to or guide us, so our research began with containers of a completely different structure to what we use now.

Initial outside-air cooling container concept (excerpt from internal planning documents)

2010 Next-generation data center demonstration testing

Our research into outside-air cooling methods continued. In February 2010, we installed a container in the Chubu region and began conducting tests of outside-air cooling methods with nine 46U racks fully loaded with running servers. This was an experiment to see if a load like this could be sufficiently cooled with outside air.

When it gets too cold in winter, condensation and static electricity occur, so we mixed exhaust heat with the outside air, and in summer, we ran the compressor during the daytime, all the while collecting basic data from the unit to facilitate optimal air-conditioning and humidity control.

As a result, we achieved a fairly astonishing pPUE of 1.04, verifying that the system would be quite effective for commercial use.

Press release:

  • IIJ conducts demonstration testing aimed at building a next-generation modularized eco-friendly data center (November 26, 2009) (in Japanese only)

2011 Matsue Data Center Park opens

These efforts culminated in the August 2010 announcement of plans to build a containerized data center and then the April 2011 opening of Matsue Data Center Park.

Press releases:

  • IIJ commences construction of Matsue Data Center Park, Japan’s first commercial data center composed of outside-air cooled containerized units (August 26, 2010) (in Japanese only)
  • IIJ opens Matsue Data Center Park, begin offering IIJ GIO Private HaaS (April 26, 2011) (in Japanese only)

The advantages of containerized data centers start with the overwhelmingly low-cost construction. Yet the units are also sturdy because they are one-storey, hexagonal metal structures. In addition, outside-air cooling means that power consumption is drastically lower than that of urban data centers with conventional air conditioning. Our original rationale with this was to save on electricity bills, but it has also turned out to be a big advantage as Japan at large strives to save on power usage in the wake of the 2011 Great East Japan Earthquake.

Another advantage is the highly efficient use of equipment space. The system can supply 90kVA, enough to house and run over 300 servers in a single container while also cooling the heat load. Currently, urban data centers can commonly only provide 4–6kVA per rack, and the issue with this is that the height of a 42U rack goes underutilized because it can only be roughly half filled. The cost of providing cloud services like IIJ’s would be high in this case. Efficient use of equipment mounting space represents a huge advantage for service providers.

Another big advantage is the high utilization efficiency, because you can add containers as and when you need them. Installation-wise, the rack mounting and cabling is done at our server kitting center, and we make the units the maximum size transportable by truck under Japanese road traffic law. This practice significantly compresses the lead time when containers need to be added. In other words, the time between making a capital outlay and starting to recoup the investment is extremely short.

Containerized data centers are excluded from the classification of buildings on the premise that human beings do not normally enter the space. This is why IIJ seeks to further reduce costs by, basically, using containerized data centers to house sets of equipment in cases where physical failures and service provision can be conceptually separated from each other, such as with IIJ GIO virtual machine services. Another reason is that with virtual servers, it is easy to switch services at another location in the event of an accident or disaster. Meanwhile, we believe it is more advantageous to install customer-supplied equipment that requires physical maintenance in conventional urban data centers given the need for maintainability and networking flexibility. IIJ aims to combine the advantages of containerized data centers with the features of urban data centers to provide the systems customers desire at low cost.

2013 All-outside-air containerized data center demonstration testing

In April 2013, we started demonstration testing of co-IZmo, all-outside-air cooled containerized data centers integrating IT and air-conditioning equipment into a single module, with the aim of reducing the size and energy consumption of containerized data centers.

Press release:

2013
November: Development of indirect outside-air cooled containerized data cente

To serve the diverse needs of our customers even better, we developed a new containerized data center module called co-IZmo/I, imbued with the insights we had gained through demonstration testing ongoing since 2013 on our IZmo outside-air cooled containerized data center modules as well as our co-IZmo/D modules designed for even greater energy savings by virtue of year-round outside-air cooling.
IIJ’s co-IZmo/I integrates IT and air-conditioning equipment into a single module housed in a readily transportable (ISO standard) 20-foot container, offering flexibility that makes it suitable for small- up to large-scale installations.

Press release:

2013 November: Expansion of Matsue Data Center Park

Until this point, we had been using this data center as the facility for the IIJ GIO Service, our own cloud service, but with usage of the IIJ GIO Service rising steadily, and in anticipation of future growth in cloud demand, we commenced expansions to the facility in April 2013 that would double its size. In conjunction with this, we also built a housing space for customers’ own IT equipment.

Press release:

2014
Selected for feasibility study on installation of containerized data center in Laos

Japan’s Ministry of Economy, Trade and Industry (METI) selected IIJ to implement a feasibility study on containerized data centers based on the Joint Crediting Mechanism (JCM) project in the Lao People’s Democratic Republic (Laos), as part of METI's publicly tendered FY2014 Global Warming Mitigation Technology Promotion Project*1.

Laos was upgrading its domestic IT infrastructure in the run up to the establishment of the ASEAN Economic Community by 2015. The country planned to build environmentally conscious, nationally run data centers as part of this effort. IIJ’s task was to investigate the feasibility of reducing greenhouse gas emissions in Laos using its technologies for building high-efficiency containerized data centers.

Press release:

*1. Global Warming Mitigation Technology Promotion Project

The Japanese government is actively seeking to transfer Japan’s world-class decarbonization technologies and products to developing economies and engaging in a Joint Credit Mechanism (JCM) with developing economies in pursuit of global-level solutions to global warming. This project will study the feasibility of the JCM and Japan’s decarbonization technologies and products by offering policy proposals to partner countries in which there are prospects for building systems and institutions and by proposing business schemes for the adoption of decarbonization technologies and products.

2015 Teardown assessment of containerized data center

We did a teardown of a demonstration testing container to perform diagnostics on its otherwise inaccessible internals.

Power software proof-of-concept

We evaluated power-prediction and peak-shaving control software.

2016
co-IZmo/I V2 (conjoined containerized data center using multiple energy sources)

We built and evaluated a containerized data center test unit that uses new air-conditioning control, solar power, fuel cells, and a DC UPS.

co-IZmo/I delivered to Laos

Adopted for a bilateral JCM demonstration project in Laos based on the advanced low-carbon technologies built into co-IZmo/I.

*JCM: Joint Crediting Mechanism (a bilateral crediting mechanism)

*Selected for a demonstration project conducted by Japan’s New Energy and Industrial Technology Development Organization (NEDO)

2017 Immersion cooling system proof-of-concept

We assessed the system’s installability and operability, and compared it with air-conditioning systems.

We also studied other possible use cases, including the cooling of GPU-equipped servers for AI and HPC (high-performance computing).

co-IZmo/I modules (year-round indirect outside-air cooled containerized data centers) introduced at Matsue Data Center Park.

2018
Demonstration testing of co-IZmo/Z (20-foot ISO container-housed data center)

We built and tested a low-cost version of our containerized data center that uses a refrigerated air-conditioning system.

2019
Opened system module-type data center that inherits our outside-air cooling technology and also features new technologies

We opened Shiroi Data Center Campus in May 2019. The campus is to feature AI-driven control and robot technologies, and will host a range of demonstration testing efforts.

2020 Shiroi Wireless Campus open

Provides sandboxed and lab environments for a range of wireless systems, including local 5G.


End of the page.

Top of Page