Network storage decisions of Sanbolic Company

According to materials of Sanbolic Company

Review contents:

Data storage systems for TV Application technology of the uniform disk arrays from Avid Technology Decisions of Ehance Tech company SANStream from Huge Systems DriveBox from JC System Integration VelocityQ and Storage Area Networks (SAN) Network decisions from Medea Palladium architecture SAN/NAS decisions from Raidtec Network storage decisions of Sanbolic Company Storage in the broadcast environment

Sanbolic is well-known in the market of the information technology successfully used also in the TV production and broadcasting. This company is specialized on the software, allowing to organize the network systems of storage of a material with the common access to it. Shock “holder” of the company products includes the program of the storage volume distribution Kayo and the file system Melio FS. Both products are successfully applied to the organization of systems of network storage of the big data assets, including video material.

Kayo 3.0

Kayo 3.0 application works with the computers connected to SAN, and allows to increase an efficiency of intranetworking communications. SAN systems provide an infrastructure for fast expansion of the storage volume, and also allow organizing a fast access to the data. In present there is the precisely traced tendency to create the SAN systems distinguished by scalable architecture, high reliability and large throughput, that large number of computers is provided by simultaneous access to the information.

Application Kayo enables for several computers to divide the disk spaces of the SAN storage among themselves. Kayo is applied in:

• Video and audio editing;
• Pre-printing preparation;
• CAD/CAM systems;
• Local Web-systems;
• Cluster servers;
• Streaming systems;
• Applications of redundant copying.

All these application variants allow to ensure a high efficiency of working groups, raising it on 30% and more. The user when he is working with Kayo, may concentrate on the decision of concrete creative or other tasks, not meditate on architecture of storage of system.

IT-managers are frequently confronted with the problem of control by constantly increasing volumes of valuable information. They are asked for Increase of productivity of informational capacious applications and the applications providing a comfortable functioning of working groups. Naturally, not the last is the requirement of reduction of the general charges for data storage. For the decision of all these problems the application Kayo was also created.

Priorities of any operational system are the control of execution of computing processes, the control of data streams between the computer and peripheral devices, and also the organization of data structure which are stored on hard disks of the computer. The standard operational system, for example Windows NT or Windows 2000/XP, requires the additional software for the organization of the SAN system providing joint access to disks or files. And Kayo provides such functionality.

It is visible in the example of work with video material where within the framework of working group one specialist may edit a video material while another at the same time — to operate with an audio, and the third — to carry out the checking, etc.

Such working groups work simultaneously independently and together, and with the same information and at the same time. And without use of such applications as Kayo, teamwork with the data may result in their damage and decrease of the general productivity of working group.

Till certain time working with video presumed, that each workstation was connected to a storage array. Each user had the own storehouse connected to station by means of standard Ethernet network. At such approach the unique variant of teamwork with a material is the transfer of files on Ethernet or physical transfer of a hard disk from one station to another. But even at use of Gigabit Ethernet technology at the network transfer of the large data volume the user all the same may not amount to the productivity comparable with Fiber Channel SAN. The basic problem in each of these two cases is that the user can not work with the data while they are in process of transfer.

SAN systems will allow to not interrupting the working process, and Kayo provides the mechanism of the shared access of workstations to the information. In the majority of the companies the storage volume can grow on 50…100% annually. Inability quickly and easily ensures the joint access from various platforms to the information may prevent to use the available information that will deprive the information value for this company completely. As a result of the users of local networks struggle for constant and reliable access to the data is the SAN systems.

Windows 2000/NT based shared data storage array

SAN system includes the storehouse of joint access, concentrators or switchboards and several workstations. Each station is equipped with the adapter of Fiber Channel bus (one or more depending on the configuration). On one of computers the program application, providing the control of access to storehouse on base LUN (Logical Unit Number), and also carrying out the monitoring of productivity and functionality of a array is also installed.

An operational system is required by any workstation. When loading of operational system on each station is carried out, the scanning of SCSI units is made and the assumption is done, that all storage units are located in the system. To avoid the unit overflow during data recording from all connected stations (each of which “thinks”, that all storage volume is belonged only to it), the utility of masking LUN is applied.

Example of SAN volume sharing using Kayo

The principle of action of this utility consists that by means of such masking there is an opportunity of consolidation of the storage volume when each station is provided by exactly assigned disk space (see fig. below).

The whole storage volume shares on LUNs, and each workstation “considers”, that it provides by certain part of the general storage volume (one or some LUNs). Lack of such approach is in that there is no opportunity to ensure the safe simultaneous access to files from several workstations as they do not have general access to all storage volume.

For overcoming of restrictions of masking by LUN the user of SAN may install the application Kayo on each workstation. Due to physical connection SAN according to the circuit “point-to-point” and by means of the application Kayo for joint access all users may get the access to all disks of the shared storage as to local devices of data storage.

On each of disks at each moment of time only one client may to record, but all other users SAN may read out the information located on a disk on which recording is made at present. Each station may send an inquiry about transmission of the right on recording from the station which this disk or storage volume is belonged to. These inquiries are transferred as command and control messages on Ethernet. The station-owner of this disk space may satisfy this inquiry or reject it.

If the station for which the given space of disk space is fixed, transfers the right to access of other station record, and the latter creates or deletes any file, so the function of updating informing on changes, occurred in this area of disk space, is automatically activated.

If the station which has received the access to record, during certain time does not carry out operation of recording, the disk space is automatically considered free and access to record in this area of storage may be transferred to any other user of the SAN network.

It is interesting to consider how Kayo will be presented for the user. Actually it is simple to user to adapt for work with Kayo as this application is integrated in interface Windows Explorer that makes its easily accessible to studying and use. The application is also characterized by the centralized control.

Kayo was developed for achievement of a maximum level of reliability and stability of systems SAN by exception of necessity in the metadata controller MDC (Meta Data Controller). MDC it is used in some program applications for control of user access to SAN. The basic problem during MDC using is that through this controller should pass absolutely all system data. It results in occurrence of two potential problems. First, SAN system constantly extends and MDC becomes the “bottleneck” which is slowing down the data exchange in SAN system. Second, MDC is a point of the probable failure interfering work of all system: if refuse the MDC so the whole SAN will refuse.

Kayo is free from all these problems as its structure does not include MDC. Any station (or all at once) in frameworks of Kayo SAN may fail, but it will not result in disturbance of access to the data. Users of Kayo may cooperate with each other, operating by access to the data and not have any problems with productivity, which are typical for MDC.

Kayo is the hardware-independent decision. It means, that it is possible potentially use any storage units, switchboards, concentrators and the bus adapters.

Also, Kayo allows carrying out the centralized reserve copying of the data with record of a backup copy on a magnetic tape.

As to positioning of application Kayo it is provided for application in SAN environment for working groups where the number of the connected users may be in the range of 2…50, each of which represents a workstation on base Windows NT and/or Windows 2000/XP. All connected users will get the joint access to storage resources, and every work is characterized by flexibility, reliability and high efficiency. Besides, there is configuration Kayo for the number of users exceeding 50. One more advantage Kayo is the minimal term of training of the personnel and the absence of intensive administrative activity. Also, there is no a server of metadata, that provides higher reliability of system and minimizes expenses for its maintenance.

Melio FS

Melio FS is the cluster file system developed especially for use in the environment of network shared storage. It provides the decision on creation of the storage system of the general access as uniform pool of stored data with joint access to them, horizontal scaling or connection of applications, cluster processing, and also with essentially simplified maintenance of the storage volumes and control of them. This system provides the new expanded opportunities to users by way of hardware storage resources using in a combination with operation simplicity.

All network servers are connected to centralized pool of storage units and can simultaneously get access to reading and recording of files which are carried out on high-speed network Fiber Channel. Besides it Melio FS allows to use computing resources of the computer more effectively, to use them more flexibly and if necessary to expand it.

Melio FS is easily installed, is simple in work, and its architecture supports platforms Windows and Unix. This file system is intended for the users requiring for technological process on the basis of working groups, for the centers of the information processing inside enterprises, cluster and the segmented computer applications.

Melio FS operation scheme within workgroup

The basic spheres of application are the following:

• Banking;
• TV broadcasting;
• Systems of the automated design;
• Centers of work with databases;
• Centers of the information processing;
• Creation of digital content;
• Design working groups;
• Finance;
• Public health services;
• Insurance business;
• Production of TV programs;
• Pre-printing preparation;
• Real estate;
• Services of the seismic analysis;
• Delivery of services;
• Streaming;
• Telecommunications;
• Video on demand;
• Internet-pools.

When Melio FS applies in the environment with working groups, for example in case of the digital content creation, picture processing, pre-printing preparations, broadcasting and production of TV programs, the users will get some advantages from joint access to files. Due to use of transport Fiber Channel environment the simultaneous record in a file which is in storehouse of joint access, and with high efficiency and on base of more perfect technological process, is provided.

Melio FS organizes the performance of all operations optimizing work of SAN system at whole, and give an access to everyone for whom it is necessary (certainly, in frameworks of SAN).

Using of Melio FS does not impose on system of any additional restrictions. The bandwidth needed for applications functioning, which are operated with the large files, is only restricted by opportunities of the hardware and does not lowered by Melio FS installation. All workstations are directly connected to the storage system. The architecture of file system provides fast access to files without any dependence from it size and number of streams.

If to consider the work of Melio FS on an example of a complex for program-making in HDTV format the system provides simultaneous access of reading/recording of files of non-compressed 10-bit video in HDTV format:

• For working groups allows to edit non-compressed HD material, eliminating the general problem of HDTV production;
• Provides a bandwidth 1 GB/sec at work with storage of joint access.

If speak about stream broadcasting in MPEG-4 format so the Melio FS allows to ensure simultaneous access of reading to a file for 10,000 users.

Material provided by Sanbolic Company