|
Replies:
8
-
Last Post:
Jan 30, 2007 4:04 AM
by: rt86616
|
|
|
Posts:
917
From:
Registered:
4/28/05
|
|
|
|
Near Real-time replication; Thumper-to-Thumper failover
Posted:
Dec 14, 2006 12:17 PM
To: Communities » storage » discuss
|
|
I've been looking around for some ideas on how to create a nearly real-time mirrored configuration between independent storage systems. A good example would be 2 Thumpers. I'd like to get to a place where if I needed to take one offline I could do it without having to take an outage for replications to occur.
The ideas I've come up with this far aren't good ones. Everything from rsycn'ing (or zfs send) every 5 minutes from cron (assuming a single run could even run that quickly) to using port mirroring to split each incoming transaction to 2 systems. Software ideas, like writing an NFS intercepter that takes incoming transactions and then sends one to disk and another to the standby system, are fun to think about but definitely not practical.
The NetApp style snapmirror method (ie: zfs send on a regular rotation) is only so exciting because any failover looses a good amount of data making it a good backup method but definitely not transparent.
Has anyone rolled over a good way to do this? I'd love to have a dialog on the topic and see what ideas bubble up.
benr.
|
|
|
Posts:
164
From:
Zurich, Switzerland
Registered:
6/17/05
|
|
|
|
Re: Near Real-time replication; Thumper-to-Thumper failover
Posted:
Dec 14, 2006 11:34 PM
in response to: benr
To: Communities » storage » discuss
|
|
I don't know if this helps, but at a former company, we used the Sun Stor[edge|ageTek] Availability Suite for UFS Filesystems. The suite includes a remote mirror functionality. This would be what you are looking for.
Unfortunatly, I guess there is no ZFS support and it cost $$$.
Here's the information: http://www.sun.com/storagetek/management_software/data_protection/availability/
Hello Sun, where is the opensource version? Where is ZFS support? Where's the free to use without support license?
Message was edited by:
burana
|
|
|
|
|
Posts:
937
From:
AU
Registered:
3/9/05
|
|
|
|
|
|
Posts:
1,264
From:
US
Registered:
8/5/05
|
|
|
|
Re: Re: Near Real-time replication;
Thumper-to-Thumper failover
Posted:
Dec 15, 2006 4:34 AM
in response to: burana
|
|
On 12/15/06, Mika Borner <mika dot borner at bluewin dot ch> wrote:
> I don't know if this helps, but at a former company, we used the Sun Stor[edge|argeTek] Availability Suite for UFS Filesystems. The suite includes a remote mirror functionality. This would be what you are looking for.
I suspect you could do this with veritas volume replicator. That
would mean, however, that you would need to run ZFS on top of Veritas
volumes. Probably not a big deal - you could do one volume per disk
if you like. However, it would add complexity and cost. You would
only be able to have ZFS imported on one machine at a time.
Mike
--
Mike Gerdts
http://mgerdts.blogspot.com/
_______________________________________________
storage-discuss mailing list
storage-discuss at opensolaris dot org
http://mail.opensolaris.org/mailman/listinfo/storage-discuss
|
|
|
|
|
Posts:
22
From:
Colorado
Registered:
8/25/06
|
|
|
|
Re: Re: Near Real-time replication;
Thumper-to-Thumper failover
Posted:
Dec 15, 2006 6:36 AM
in response to: mgerdts
|
|
Actually Mike Borner is right. We have AVS and intend to Open source
it very soon. This is a very good product to use for the inital
issue Ben wanted to solve.
The head developer will be responding.
/scott
On Dec 15, 2006, at 5:34 AM, Mike Gerdts wrote:
> On 12/15/06, Mika Borner <mika dot borner at bluewin dot ch> wrote:
>> I don't know if this helps, but at a former company, we used the
>> Sun Stor[edge|argeTek] Availability Suite for UFS Filesystems. The
>> suite includes a remote mirror functionality. This would be what
>> you are looking for.
>
> I suspect you could do this with veritas volume replicator. That
> would mean, however, that you would need to run ZFS on top of Veritas
> volumes. Probably not a big deal - you could do one volume per disk
> if you like. However, it would add complexity and cost. You would
> only be able to have ZFS imported on one machine at a time.
>
> Mike
>
> --
> Mike Gerdts
> http://mgerdts.blogspot.com/
> _______________________________________________
> storage-discuss mailing list
> storage-discuss at opensolaris dot org
> http://mail.opensolaris.org/mailman/listinfo/storage-discuss
Scott Tracy
Director
Sun Microsystems
SAN Software
303-225-7551
_______________________________________________
storage-discuss mailing list
storage-discuss at opensolaris dot org
http://mail.opensolaris.org/mailman/listinfo/storage-discuss
|
|
|
|
|
Posts:
305
From:
US
Registered:
3/9/05
|
|
|
|
Re: Re: Near Real-time replication;
Thumper-to-Thumper failover
Posted:
Dec 15, 2006 6:37 AM
in response to: burana
|
|
All,
> I don't know if this helps, but at a former company, we used the Sun Stor[edge|argeTek] Availability Suite for UFS Filesystems. The suite includes a remote mirror functionality. This would be what you are looking for.
>
> Unfortunatly, I guess there is now ZFS support and it cost $$$.
>
> Here's the information: http://www.sun.com/storagetek/management_software/data_protection/availability/
>
> Hello Sun, where is the opensource version? Where is ZFS support? Where's the free to use without support license?
>
As the Availability Suite Project & Technical Lead, I will take this
opportunity to say that in January '07, all of the Sun StorageTech
Availability Suite (AVS) software is going into OpenSolaris!
This will include both the Remote Mirror (SNDR) and Point-in-Time Copy
(II) software, which runs on OpenSolaris supported hardware platforms of
SPARC, x86 and x64.
AVS, being both file system and storage agnostic, makes AVS very capable
of replicating and/or taking snapshots of UFS, QFS, VxFS, ZFS, Solaris
support databases (Oracle, Sybase, etc.), contained on any of the
following types of storage: LUNs, SVM & VxVM volumes, lofi devices, even
ZFS's zvols.
So going back to the initial posting...
> I've been looking around for some ideas on how to create a nearly real-time mirrored configuration between independent storage systems. A good example would be 2 Thumpers. I'd like to get to a place where if I needed to take one offline I could do it without having to take an outage for replications to occur.
>
> The ideas I've come up with this far aren't good ones. Everything from rsycn'ing (or zfs send) every 5 minutes from cron (assuming a single run could even run that quickly) to using port mirroring to split each incoming transaction to 2 systems. Software ideas, like writing an NFS intercepter that takes incoming transactions and then sends one to disk and another to the standby system, are fun to think about but definitely not practical.
>
> The NetApp style snapmirror method (ie: zfs send on a regular rotation) is only so exciting because any failover looses a good amount of data making it a good backup method but definitely not transparent.
>
> Has anyone rolled over a good way to do this? I'd love to have a dialog on the topic and see what ideas bubble up.
>
>
>
The SNDR portion of Availability Suite, is very capable of replicating
ZFS. Due to the nature of ZFS itself, the unit of replication or
snapshot is a ZFS storage pool, not a ZFS file system. The relationship
between the number of file systems in each storage pools is left to the
discretion of the system administrator, being 1-to-1 (like older file
systems), or many-to-1 (as is now possible with ZFS).
SNDR can replicate any number of ZFS storage pools, where each of the
vdevs in the storage pool (zpool status <name>), must be configured
under a single SNDR I/O consistency group. Once configured, the
replication of ZFS, like all other Solaris supported file systems, works
with both synchronous and asynchronous replication, the latter using
either memory queues or disks queues.
This product set is well documented and can seen at
http://docs.sun.com/app/docs?p=coll%2FAVS4.0
The current release notes for AVS 4.0 are located at
http://docs.sun.com/source/819-6152-10/AVS_40_Release_Notes.html
More details will be forthcoming in January, so please keep a look out
for Sun StorageTech Availability Suite in 2007!
Regards,
Jim Dunham
>
>
> This message posted from opensolaris.org
> _______________________________________________
> storage-discuss mailing list
> storage-discuss at opensolaris dot org
> http://mail.opensolaris.org/mailman/listinfo/storage-discuss
>
_______________________________________________
storage-discuss mailing list
storage-discuss at opensolaris dot org
http://mail.opensolaris.org/mailman/listinfo/storage-discuss
|
|
|
|
|
Posts:
917
From:
Registered:
4/28/05
|
|
|
|
Re: Re: Near Real-time replication;
Posted:
Jan 29, 2007 5:27 PM
in response to: jdunham
To: Communities » storage » discuss
|
|
Any update on AVS?
benr.
|
|
|
|
|
Posts:
917
From:
Registered:
4/28/05
|
|
|
|
|
|
Posts:
22
From:
Colorado
Registered:
8/25/06
|
|
|
|
Re: Re: Re: Near Real-time replication;
Posted:
Jan 30, 2007 4:04 AM
in response to: benr
|
|
And note the technical lead has (re) started his blog on this:
/Scott On Jan 29, 2007, at 6:44 PM, Ben Rockwood wrote: Self update:
Good times ahead.
benr.
This message posted from opensolaris.org _______________________________________________ storage-discuss mailing list
Scott Tracy Director Sun Microsystems 303-225-7551
|
|
|
|
|
