Transcript ppt - Apnic
New Version of the RIPE Database Andrei Robachevsky RIPE NCC <[email protected]> 1 Andrei Robachevsky . 12th APNIC Open Plicy Meeting, August 2001, Taipei, Taiwan . http://www.ripe.net Outline • Current status of the RIPE Database • New database software • RIPE Database migration 2 Andrei Robachevsky . 12th APNIC Open Plicy Meeting, August 2001, Taipei, Taiwan . http://www.ripe.net RIPE Database Status • Contains • IP allocations/assignments • Domain registry • Routing registry • More than 4 Million objects • 84% person, 11% inetnum, 0.66% route • 6,700 updates/day • Up to 1.5 Mqueries/day (15 queries/s) • 38% IP addresses, 1% IP prefixes • Up to 15% are denied 3 Andrei Robachevsky . 12th APNIC Open Plicy Meeting, August 2001, Taipei, Taiwan . http://www.ripe.net Distribution by object type (August 2001) mntner 0.16% role 0.11% person 84.21% route 0.66% Other 4.49% as-block 0.00% domain 3.38% inetnum 11.29% aut-nm 0.12% 4 Andrei Robachevsky . 12th APNIC Open Plicy Meeting, August 2001, Taipei, Taiwan . http://www.ripe.net Andrei Robachevsky . 12th APNIC Open Plicy Meeting, August 2001, Taipei, Taiwan . Jul-01 Jun-01 May-01 Apr-01 Mar-01 Feb-01 Jan-01 Dec-00 Nov-00 Oct-00 Sep-00 Aug-00 Jul-00 Jun-00 May-00 Apr-00 Mar-00 Feb-00 Jan-00 Dec-99 Nov-99 Oct-99 Sep-99 Aug-99 Jul-99 Queries/s Queries reached 15 q/s average (35q/s max) 16 14 12 10 8 6 4 2 0 Month 5 http://www.ripe.net % of queries by object type domains 27% other 29% domains IP prefixes other prefixes 1% IP 43% 6 Andrei Robachevsky . 12th APNIC Open Plicy Meeting, August 2001, Taipei, Taiwan . http://www.ripe.net Updates 7 per min 25 20 15 domain person inetnum all 10 5 Jul-01 Jun-01 May-01 Apr-01 Mar-01 Feb-01 Jan-01 Dec-00 Nov-00 Oct-00 Sep-00 Aug-00 Jul-00 Jun-00 May-00 Apr-00 Mar-00 Feb-00 Jan-00 Dec-99 Nov-99 Oct-99 Sep-99 Aug-99 Jul-99 0 Month 7 Andrei Robachevsky . 12th APNIC Open Plicy Meeting, August 2001, Taipei, Taiwan . http://www.ripe.net Database Software v3 • Functionality • Architecture • Performance 8 Andrei Robachevsky . 12th APNIC Open Plicy Meeting, August 2001, Taipei, Taiwan . http://www.ripe.net New version of the RIPE Database • Supports RPSL (RFC2622) • Extended syntax • New objects and attributes • Supports RPSS (RFC2725) • New authorization rules • Supports RAToolset • RtConfig -protocol ripe • Code is completely rewritten 9 Andrei Robachevsky . 12th APNIC Open Plicy Meeting, August 2001, Taipei, Taiwan . http://www.ripe.net RPSL features • Provides rich syntax for expressing routing policies • router configuration ready • RPSL syntax extensions apply to all object types • end of line comments • line continuation • order of attributes • New objects • as-block, as-set (as-macro), route-set (community) • peering-set, filter-set, rtr-set • New attributes • member-of, mbrs-by-ref • mnt-routes: <mnt_name> [ rpsl list of prefixes | ANY] • referral-by: <mnt_name> 10 Andrei Robachevsky . 12th APNIC Open Plicy Meeting, August 2001, Taipei, Taiwan . http://www.ripe.net Security features • Provides strong security mechanisms • • • • • • • Protection of individual objects Protection of IP address space Protection of ASN space Protection of route space Protection of set membership Protection of hierarchical set names Protection of domain object space • 4 supported auth schemes • GPG public keys are supported 11 Andrei Robachevsky . 12th APNIC Open Plicy Meeting, August 2001, Taipei, Taiwan . http://www.ripe.net New software • Mainly in C, multithreaded • CPU: 70% idle • RDBMS as a back-end • MySQL, customized transaction support • In-memory radix tree for IP lookups • also more and less specific lookups for reverse delegation domains • MIME and GPG support • correct PGP keys are also accepted • Automatic access control • separate accounting for public and contact data 12 Andrei Robachevsky . 12th APNIC Open Plicy Meeting, August 2001, Taipei, Taiwan . http://www.ripe.net Server architecture Message queues Syntax checks, acks, notifications queries Queue rules RDBMS Update FE Core Server E-mail Update FE NRTM clients Mirror Server RDBMS 13 Andrei Robachevsky . 12th APNIC Open Plicy Meeting, August 2001, Taipei, Taiwan . http://www.ripe.net 80.00 Query Performance (I) Query rate, q/s V3 operational zone 60.00 V3 40.00 V2 V2 operational zone 20.00 0.00 0.00 Andrei Robachevsky 20.00 . 40.00 60.00 12th APNIC Open Plicy Meeting, August 2001, Taipei, Taiwan # of concurrent clients . http://www.ripe.net 14 4.00 Query Performance (II) Response time, s V3 operational zone 3.00 V3 2.00 V2 V2 operational zone 1.00 0.00 0.00 Andrei Robachevsky 20.00 . 40.00 60.00 12th APNIC Open Plicy Meeting, August 2001, Taipei, Taiwan # of concurrent clients . http://www.ripe.net 15 Transition phases • Pre-migration period • Conversion to RPSL • Prototype servers • Transition period • 23 April: Migration Night • RIPE-181 compatibility mode • Finalizing the migration • ftp site structure • deprecating legacy stuff 16 Andrei Robachevsky . 12th APNIC Open Plicy Meeting, August 2001, Taipei, Taiwan . http://www.ripe.net Pre-migration: RIPE181 -> RPSL • Sets • as-macro: <macro_name> => as-set: <macro_name> • community: <comm_name> => route-set: RS-<comm_name> • Reserved prefixes (RP) • AS-, RS-, RTRS-, FLTR-, PRNG• mntner: <RP><mt_name> - 9 cases, all resolved by the owners • as-name: <RP><name> => ASN-<name> • Mandatory attribute: mnt-by (except dn, pn, ro) • no mnt-by => mnt-by: RIPE-NCC-NONE-MNT • no mnt-by (aut-num’s) => mnt-by: RIPE-NCC-AN-MNT • New attribute: referral-by • => referral-by: RIPE-DBM-MNT 17 Andrei Robachevsky . 12th APNIC Open Plicy Meeting, August 2001, Taipei, Taiwan . http://www.ripe.net Pre-migration: prototype servers • Near real-time mirror of the RIPE Database • whois -h rpsl.ripe.net • contains live RIPE Database in RPSL format • Test server for submissions • mail <[email protected]> • whois -h rpsl.ripe.net -p 4343 • NRTM • rpsl.ripe.net, port 4444 • please contact <[email protected]> 18 Andrei Robachevsky . 12th APNIC Open Plicy Meeting, August 2001, Taipei, Taiwan . http://www.ripe.net Pre-migration: milestones • April 5 ripe-dbase-3.0 release • April 12 Advised mirrors’ switchover • 4 servers switched to the RPSL mirror • April 19 Migration if the TESTDatabase • dress rehearsal of the migration 19 Andrei Robachevsky . 12th APNIC Open Plicy Meeting, August 2001, Taipei, Taiwan . http://www.ripe.net Transition: Compatibility mode • RIPE-181 updates • can be sent to a separate mail robot • automatically converted to RPSL • PGP authentication • cannot be used • RPSL syntax rules • • • • empty attributes are not allowed optional -> mandatory no aliases no prefix notation 20 Andrei Robachevsky . 12th APNIC Open Plicy Meeting, August 2001, Taipei, Taiwan . http://www.ripe.net Transition: issues Routing Policy System Security (RFC2725) • new authorisation rules for route creation • need to duplicate objects in the RIPE DB • encompassing inetnum with NONE auth for mnt-routes • as-blocks for non RIPE space with NONE auth for mnt-lower • low level of security in non RIPE space • still apply in RIPE-181 compatibility mode • V2 undocumented features • leading white space stripping • correcting misspelled attributes • filtering out empty attributes 21 Andrei Robachevsky . 12th APNIC Open Plicy Meeting, August 2001, Taipei, Taiwan . http://www.ripe.net Transition timeline Production Prototype/Compatibility RIPE181 Updates in RIPE-181 to <[email protected]> Updates in RPE-181 to <[email protected]> Updates in RPSL to <[email protected]> RPSL TEST Updates in RIPE-181 to <[email protected]> Updates in RPSL to <[email protected]> X=23 April Updates in RPSL to <[email protected]> Updates in RPSL to <[email protected]> Y=14 May Z=15 October 22 Andrei Robachevsky . 12th APNIC Open Plicy Meeting, August 2001, Taipei, Taiwan . http://www.ripe.net Future Plans • Provide support for several platforms • Solaris (SPARC & Intel) • Linux (RedHat) • FreeBSD • New features • DB and object schema/syntax, object library • extensions to RFC2725 implementation 23 Andrei Robachevsky . 12th APNIC Open Plicy Meeting, August 2001, Taipei, Taiwan . http://www.ripe.net More Information • RIPE-181 to RPSL Migration page • http://www.ripe.net/rpsl • Documentation • RIPE Database Reference Manual http://www.ripe.net/ripe/docs/databaseref-manual.html • RIPE Database User Manual (coming soon) • RIPE Database Operation Manual (coming soon) • Software • New whois client ftp://ftp.ripe.net/tools/ripe-whois-3.0.tar.gz • Server software v3 ftp://ftp.ripe.net/ripe/dbase/software/ripe-dbase-3.0.1.tar.gz 24 Andrei Robachevsky . 12th APNIC Open Plicy Meeting, August 2001, Taipei, Taiwan . http://www.ripe.net