Hi Miguel, good morning!,
i was able to upload the DB snapshot (it took my laptop 4 days of instant work, but the issue is only my machine config) and tried to continue with NRTM
i followed the setup procedure as described:
and
for DB (dump, tables update) and NRTM config in properties, but whois can’t start now, i tried to rebuild it, but the picture stays he same, would you kindly have a glance if possible?
start logs:
====================
root@RIPE:/home/maxim/whois# /usr/bin/java -Dwhois -XX:-HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/export/tmp -XX:ErrorFile=var/hs_err_pid%p.log -Djsse.enableSNIExtension=false -Dcom.sun.management.jmxremote -Dhazelcast.jmx=true -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.port=1099 -Xms1024m -Xmx8g -Dwhois.config=properties -Duser.timezone=UTC -Dhazelcast.config=hazelcast.xml -Dlog4j.configurationFile=file:log4j2.xml -jar whois.jar
WARNING: sun.reflect.Reflection.getCallerClass is not supported. This will impact performance.
2023-07-13T07:26:36,736 INFO [WhoisRipePropertyResolver] Instance name is RIPE
2023-07-13T07:26:37,443 INFO [MLog] MLog clients using slf4j logging.
2023-07-13T07:26:37,516 INFO [C3P0Registry] Initializing c3p0-0.9.5.5 [built 11-December-2019 22:18:33 -0800; debug? true; trace: 10]
2023-07-13T07:26:37,904 WARN [DefaultSourceContext] GRS Source already configured: RIPE-GRS
2023-07-13T07:26:37,904 INFO [DefaultSourceContext] Using sources: [LOCAL [MASTER], LOCAL [SLAVE], RIPE-GRS [SLAVE], RIPE-GRS [MASTER]]
2023-07-13T07:26:38,002 INFO [IpRanges] Trusted ranges: [127.0.0.1/32, ::1/128]
2023-07-13T07:26:38,008 INFO [IpRanges] Loadbalancer ranges: [127.0.0.1/32, ::1/128]
2023-07-13T07:26:38,010 WARN [MaintenanceMode] Access type change: world FULL → FULL, trusted: FULL → FULL
2023-07-13T07:26:38,085 INFO [AbstractPoolBackedDataSource] Initializing c3p0 pool… com.mchange.v2.c3p0.ComboPooledDataSource [ acquireIncrement → 3, acquireRetryAttempts → 30, acquireRetryDelay → 1000, autoCommitOnClose → false, automaticTestTable → null, breakAfterAcquireFailure → false, checkoutTimeout → 0, connectionCustomizerClassName → null, connectionTesterClassName → com.mchange.v2.c3p0.impl.DefaultConnectionTester, contextClassLoaderSource → caller, dataSourceName → z8kfsxaxlokcsfvwyjss|7fd751de, debugUnreturnedConnectionStackTraces → false, description → null, driverClass → org.mariadb.jdbc.Driver, extensions → {}, factoryClassLocation → null, forceIgnoreUnresolvedTransactions → false, forceSynchronousCheckins → false, forceUseNamedDriverClass → false, identityToken → z8kfsxaxlokcsfvwyjss|7fd751de, idleConnectionTestPeriod → 15, initialPoolSize → 3, jdbcUrl → jdbc:mysql://localhost/WHOIS_MIRROR_RIPE_GRS, maxAdministrativeTaskTime → 0, maxConnectionAge → 0, maxIdleTime → 7200, maxIdleTimeExcessConnections → 0, maxPoolSize → 100, maxStatements → 0, maxStatementsPerConnection → 0, minPoolSize → 0, numHelperThreads → 3, preferredTestQuery → SELECT 1, privilegeSpawnedThreads → false, properties → {password=, user=}, propertyCycle → 0, statementCacheNumDeferredCloseThreads → 0, testConnectionOnCheckin → false, testConnectionOnCheckout → false, unreturnedConnectionTimeout → 0, userOverrides → {}, usesTraditionalReflectiveProxies → false ]
2023-07-13T07:26:53,232 INFO [AbstractPoolBackedDataSource] Initializing c3p0 pool… com.mchange.v2.c3p0.ComboPooledDataSource [ acquireIncrement → 3, acquireRetryAttempts → 30, acquireRetryDelay → 1000, autoCommitOnClose → false, automaticTestTable → null, breakAfterAcquireFailure → false, checkoutTimeout → 0, connectionCustomizerClassName → net.ripe.db.whois.common.jdbc.WhoisConnectorCustomizer, connectionTesterClassName → com.mchange.v2.c3p0.impl.DefaultConnectionTester, contextClassLoaderSource → caller, dataSourceName → z8kfsxaxlokcsfvwyjss|965bcbc, debugUnreturnedConnectionStackTraces → false, description → null, driverClass → org.mariadb.jdbc.Driver, extensions → {}, factoryClassLocation → null, forceIgnoreUnresolvedTransactions → false, forceSynchronousCheckins → false, forceUseNamedDriverClass → false, identityToken → z8kfsxaxlokcsfvwyjss|965bcbc, idleConnectionTestPeriod → 15, initialPoolSize → 3, jdbcUrl → jdbc:mysql://localhost/ACL_LOCAL, maxAdministrativeTaskTime → 0, maxConnectionAge → 0, maxIdleTime → 7200, maxIdleTimeExcessConnections → 0, maxPoolSize → 100, maxStatements → 0, maxStatementsPerConnection → 0, minPoolSize → 0, numHelperThreads → 3, preferredTestQuery → SELECT 1, privilegeSpawnedThreads → false, properties → {password=, user=}, propertyCycle → 0, statementCacheNumDeferredCloseThreads → 0, testConnectionOnCheckin → false, testConnectionOnCheckout → false, unreturnedConnectionTimeout → 0, userOverrides → {}, usesTraditionalReflectiveProxies → false ]
2023-07-13T07:26:53,275 INFO [HazelcastInstanceManager] Creating hazelcast instance with Ripe deployed profile
2023-07-13T07:26:53,688 WARN [AddressPicker] [LOCAL] [dev] [4.2.7] You configured your member address as host name. Please be aware of that your dns can be spoofed. Make sure that your dns configurations are correct.
2023-07-13T07:26:53,688 INFO [AddressPicker] [LOCAL] [dev] [4.2.7] Resolving domain name ‘localhost’ to address(es): [127.0.0.1]
2023-07-13T07:26:53,692 INFO [AddressPicker] [LOCAL] [dev] [4.2.7] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [localhost/127.0.0.1]
2023-07-13T07:26:53,778 INFO [system] [localhost]:5701 [dev] [4.2.7] Hazelcast 4.2.7 (20230207 - 83309a6) starting at [localhost]:5701
2023-07-13T07:26:54,626 INFO [Node] [localhost]:5701 [dev] [4.2.7] Using TCP/IP discovery
2023-07-13T07:26:54,627 WARN [CPSubsystem] [localhost]:5701 [dev] [4.2.7] CP Subsystem is not enabled. CP data structures will operate in UNSAFE mode! Please note that UNSAFE mode will not provide strong consistency guarantees.
2023-07-13T07:26:54,892 INFO [Diagnostics] [localhost]:5701 [dev] [4.2.7] Diagnostics disabled. To enable add -Dhazelcast.diagnostics.enabled=true to the JVM arguments.
2023-07-13T07:26:54,897 INFO [LifecycleService] [localhost]:5701 [dev] [4.2.7] [localhost]:5701 is STARTING
2023-07-13T07:26:54,958 INFO [ClusterService] [localhost]:5701 [dev] [4.2.7]
Members {size:1, ver:1} [
Member [localhost]:5701 - 4f31ba46-8d74-466d-b827-2e3e169dbd4d this
]
2023-07-13T07:26:54,979 INFO [ManagementService] [localhost]:5701 [dev] [4.2.7] Hazelcast JMX agent enabled.
2023-07-13T07:26:55,042 INFO [LifecycleService] [localhost]:5701 [dev] [4.2.7] [localhost]:5701 is STARTED
2023-07-13T07:26:55,100 INFO [HazelcastPersonalObjectAccounting] hazelcast instances loving_hugle members: [Member [localhost]:5701 - 4f31ba46-8d74-466d-b827-2e3e169dbd4d this]
2023-07-13T07:26:55,316 INFO [AbstractPoolBackedDataSource] Initializing c3p0 pool… com.mchange.v2.c3p0.ComboPooledDataSource [ acquireIncrement → 3, acquireRetryAttempts → 30, acquireRetryDelay → 1000, autoCommitOnClose → false, automaticTestTable → null, breakAfterAcquireFailure → false, checkoutTimeout → 0, connectionCustomizerClassName → net.ripe.db.whois.common.jdbc.WhoisConnectorCustomizer, connectionTesterClassName → com.mchange.v2.c3p0.impl.DefaultConnectionTester, contextClassLoaderSource → caller, dataSourceName → z8kfsxaxlokcsfvwyjss|514f2020, debugUnreturnedConnectionStackTraces → false, description → null, driverClass → org.mariadb.jdbc.Driver, extensions → {}, factoryClassLocation → null, forceIgnoreUnresolvedTransactions → false, forceSynchronousCheckins → false, forceUseNamedDriverClass → false, identityToken → z8kfsxaxlokcsfvwyjss|514f2020, idleConnectionTestPeriod → 15, initialPoolSize → 3, jdbcUrl → jdbc:mysql://localhost/INTERNALS_LOCAL, maxAdministrativeTaskTime → 0, maxConnectionAge → 0, maxIdleTime → 7200, maxIdleTimeExcessConnections → 0, maxPoolSize → 100, maxStatements → 0, maxStatementsPerConnection → 0, minPoolSize → 0, numHelperThreads → 3, preferredTestQuery → SELECT 1, privilegeSpawnedThreads → false, properties → {password=, user=}, propertyCycle → 0, statementCacheNumDeferredCloseThreads → 0, testConnectionOnCheckin → false, testConnectionOnCheckout → false, unreturnedConnectionTimeout → 0, userOverrides → {}, usesTraditionalReflectiveProxies → false ]
2023-07-13T07:26:55,877 WARN [ReservedResources] is not a valid prefix, skipping…
2023-07-13T07:26:56,086 WARN [deprecation] configuration key ‘resource.loader’ has been deprecated in favor of ‘resource.loaders’
2023-07-13T07:26:56,089 WARN [deprecation] configuration key ‘classpath.resource.loader.class’ has been deprecated in favor of ‘resource.loader.classpath.class’
2023-07-13T07:26:56,266 INFO [ClientCertificateCredentialValidator] Client certificate authentication is enabled
2023-07-13T07:26:56,391 INFO [IpTreeUpdater] Rebuild IpTrees and scheduled update using sources: [RIPE-GRS [SLAVE], LOCAL [SLAVE]]
2023-07-13T07:26:56,392 INFO [IpTreeUpdater] Initializing thread pool with 2 threads
2023-07-13T07:26:56,392 INFO [IpTreeUpdater] Building IP trees
2023-07-13T07:26:56,558 INFO [AbstractPoolBackedDataSource] Initializing c3p0 pool… com.mchange.v2.c3p0.ComboPooledDataSource [ acquireIncrement → 3, acquireRetryAttempts → 30, acquireRetryDelay → 1000, autoCommitOnClose → false, automaticTestTable → null, breakAfterAcquireFailure → false, checkoutTimeout → 0, connectionCustomizerClassName → null, connectionTesterClassName → com.mchange.v2.c3p0.impl.DefaultConnectionTester, contextClassLoaderSource → caller, dataSourceName → z8kfsxaxlokcsfvwyjss|49e479da, debugUnreturnedConnectionStackTraces → false, description → null, driverClass → org.mariadb.jdbc.Driver, extensions → {}, factoryClassLocation → null, forceIgnoreUnresolvedTransactions → false, forceSynchronousCheckins → false, forceUseNamedDriverClass → false, identityToken → z8kfsxaxlokcsfvwyjss|49e479da, idleConnectionTestPeriod → 15, initialPoolSize → 3, jdbcUrl → jdbc:mysql://localhost/WHOIS_MIRROR_RIPE_GRS, maxAdministrativeTaskTime → 0, maxConnectionAge → 0, maxIdleTime → 7200, maxIdleTimeExcessConnections → 0, maxPoolSize → 100, maxStatements → 0, maxStatementsPerConnection → 0, minPoolSize → 0, numHelperThreads → 3, preferredTestQuery → SELECT 1, privilegeSpawnedThreads → false, properties → {password=, user=}, propertyCycle → 0, statementCacheNumDeferredCloseThreads → 0, testConnectionOnCheckin → false, testConnectionOnCheckout → false, unreturnedConnectionTimeout → 0, userOverrides → {}, usesTraditionalReflectiveProxies → false ]
2023-07-13T07:26:56,593 INFO [AbstractPoolBackedDataSource] Initializing c3p0 pool… com.mchange.v2.c3p0.ComboPooledDataSource [ acquireIncrement → 3, acquireRetryAttempts → 30, acquireRetryDelay → 1000, autoCommitOnClose → false, automaticTestTable → null, breakAfterAcquireFailure → false, checkoutTimeout → 0, connectionCustomizerClassName → net.ripe.db.whois.common.jdbc.WhoisConnectorCustomizer, connectionTesterClassName → com.mchange.v2.c3p0.impl.DefaultConnectionTester, contextClassLoaderSource → caller, dataSourceName → z8kfsxaxlokcsfvwyjss|506aa618, debugUnreturnedConnectionStackTraces → false, description → null, driverClass → org.mariadb.jdbc.Driver, extensions → {}, factoryClassLocation → null, forceIgnoreUnresolvedTransactions → false, forceSynchronousCheckins → false, forceUseNamedDriverClass → false, identityToken → z8kfsxaxlokcsfvwyjss|506aa618, idleConnectionTestPeriod → 15, initialPoolSize → 3, jdbcUrl → jdbc:mysql://localhost/LOCAL, maxAdministrativeTaskTime → 0, maxConnectionAge → 0, maxIdleTime → 7200, maxIdleTimeExcessConnections → 0, maxPoolSize → 100, maxStatements → 0, maxStatementsPerConnection → 0, minPoolSize → 0, numHelperThreads → 3, preferredTestQuery → SELECT 1, privilegeSpawnedThreads → false, properties → {password=, user=}, propertyCycle → 0, statementCacheNumDeferredCloseThreads → 0, testConnectionOnCheckin → false, testConnectionOnCheckout → false, unreturnedConnectionTimeout → 0, userOverrides → {}, usesTraditionalReflectiveProxies → false ]
Killed
root@RIPE:/home/maxim/whois#
====================
properties:
============
The main / default whois source (RIPE|TEST)
whois.source=LOCAL
whois.nonauth.source=TEST-NONAUTH
whois.additional.sources=
Service ports
port.query=1043
port.api=1080
port.nrtm=1081
File system locations
dir.rpsl.export=var${jvmId:}/export
dir.rpsl.export.tmp=var${jvmId:}/export_tmp
dir.rpsl.export.internal=internal
dir.rpsl.export.external=dbase_new
dir.rpsl.export.external.legacy=dbase
dir.update.audit.log=var${jvmId:}/log/audit
dir.grs.import.download=var${jvmId:}/grs
dir.fulltext.index=
API configuration
api.rest.baseurl=http://rest.db.ripe.net
Comma separated list of GRS sources
grs.sources=RIPE-GRS
grs.sources.dummify=
Comma separated list of IP ranges from which sensitive operations are accessible
ipranges.trusted=127.0.0.1,::1
Comma separated list of IP ranges from which the OSI layer2 load balancer health checks are executed from
ipranges.loadbalancer=127.0.0.1,::1
ipranges.bogons=0.0.0.0/8,10.0.0.0/8,100.64.0.0/10,127.0.0.0/8,169.254.0.0/16,172.16.0.0/12,192.0.2.0/24,192.168.0.0/16,198.18.0.0/15,198.51.100.0/24,203.0.113.0/>
Mail properties
mail.smtp.enabled=true
mail.smtp.host=
mail.from=RIPE Database Administration local unread@ripe.net
mail.update.threads=2
mail.dequeue.interval=1000
mail.smtp.retrySending=true
NRTM server
nrtm.enabled=false
nrtm.update.interval=15
NRTM client
nrtm.import.enabled=true
nrtm.import.sources=RIPE-GRS
nrtm.import.RIPE-GRS.source=RIPE
nrtm.import.RIPE-GRS.host=whois.ripe.net
nrtm.import.RIPE-GRS.port=4444
RpslExport
rpsl.export.enabled=true
GRS source-specific properties to acquire dumps
grs.import.enabled=false
grs.import.sources=
whois.countrycodes=AD,AE,AF,AG,AI,AL,AM,AO,AQ,AR,AS,AT,AU,AW,AX,AZ,BA,BB,BD,BE,BF,BG,BH,BI,BJ,BL,BM,BN,BO,BQ,BR,BS,BT,BV,BW,BY,BZ,CA,CC,CD,CF,CG,CH,CI,CK,CL,CM,CN>
whois.languagecodes=ab,aa,af,ak,sq,am,ar,an,hy,as,av,ae,ay,az,bm,ba,eu,be,bn,bh,bi,bs,br,bg,my,ca,ch,ce,ny,zh,cv,kw,co,cr,hr,cs,da,dv,nl,dz,en,eo,et,ee,fo,fj,fi,f>
whois.reserved.as.numbers=0,64496-131071,4200000000-4294967295
whois.maintainers.enduser=RIPE-NCC-END-MNT
whois.maintainers.legacy=RIPE-NCC-LEGACY-MNT
whois.maintainers.alloc=RIPE-NCC-HM-MNT
whois.maintainers.enum=RIPE-GII-MNT,RIPE-NCC-MNT
whois.maintainers.dbm=RIPE-DBM-MNT,RIPE-NCC-LOCKED-MNT,RIPE-DBM-STARTUP-MNT,RIPE-DBM-UNREFERENCED-CLEANUP-MNT,RIPE-ERX-MNT,RIPE-NCC-RPSL-MNT
Source aware data sources
whois.db.driver=org.mariadb.jdbc.Driver
whois.db.master.driver=net.ripe.db.whois.common.jdbc.driver.LoggingDriver
whois.db.master.url=jdbc:log:mysql://localhost/LOCAL;driver=org.mariadb.jdbc.Driver
whois.db.master.username=dbint
whois.db.master.password=
whois.db.slave.url=jdbc:mysql://localhost/LOCAL
whois.db.slave.username=dbint
whois.db.slave.password=
whois.db.grs.master.baseurl=jdbc:mysql://localhost/WHOIS_MIRROR
whois.db.grs.slave.baseurl=jdbc:mysql://localhost/WHOIS_MIRROR
Common data sources
mailupdates.database.url=jdbc:mysql://localhost/MAILUPDATES_LOCAL
mailupdates.database.username=dbint
mailupdates.database.password=
acl.database.url=jdbc:mysql://localhost/ACL_LOCAL
acl.database.username=dbint
acl.database.password=
internals.database.url=jdbc:mysql://localhost/INTERNALS_LOCAL
internals.database.username=dbint
internals.database.password=
internals.slave.database.url=jdbc:mysql://localhost/INTERNALS_LOCAL
internals.slave.database.username=dbint
internals.slave.database.password=
nrtm.database.url=jdbc:mysql://localhost/NRTM
nrtm.database.username=dbint
nrtm.database.password=
nrtm.slave.database.url=jdbc:mysql://localhost/NRTM
nrtm.slave.database.username=dbint
nrtm.slave.database.password=
nrtm.file.path=/tmp
nrtm.snapshot.window=23:00 - 05:00
#Feature Toggles
feature.toggle.changed.attr.available=true
#Dummy attributes
whois.dummy={‘auth’:‘MD5-PW $1$SaltSalt$DummifiedMD5HashValue.’, ‘tech-c’:‘DR1-TEST’, ‘admin-c’:‘DR1-TEST’}
whois.zonemaster.baseUrl=http://zonemaster-test.ripe.net:5000
client.cert.auth.enabled=true
nrtm.baseUrl= https://nrtm.db.ripe.net
RDAP properties
rdap.tnc.title=Terms and Conditions
rdap.tnc.description=This is the RIPE Database query service. The objects are in RDAP format.
rdap.tnc.linkrel=terms-of-service
rdap.tnc.linkhref=http://www.ripe.net/db/support/db-terms-conditions.pdf
rdap.tnc.linktype=application/pdf
rdap.public.baseUrl=
rdap.filter.isfiltered=true
rdap.filter.description=This output has been filtered.
rdap.filter.title=Filtered
rdap.source.description=Objects returned came from source
rdap.source.title=Source
rdap.port43=whois.ripe.net
rdap.inaccuracy_notice.linkrel=inaccuracy-report
rdap.inaccuracy_notice.title=Whois Inaccuracy Reporting
rdap.inaccuracy_notice.description=If you see inaccuracies in the results, please visit:
rdap.inaccuracy_notice.linkhref=https://www.ripe.net/contact-form?topic=ripe_dbm&show_form=true
shutdown.pause.sec=0
instance.name=localhost
#spring.servlet.multipart.max-file-size=1073741824
#spring.servlet.multipart.max-request-size=1073741824
============