Class KademliaNetworkDatabaseFacade
java.lang.Object
net.i2p.router.NetworkDatabaseFacade
net.i2p.router.networkdb.kademlia.KademliaNetworkDatabaseFacade
- All Implemented Interfaces:
Service
- Direct Known Subclasses:
FloodfillNetworkDatabaseFacade
public abstract class KademliaNetworkDatabaseFacade extends NetworkDatabaseFacade
Kademlia based version of the network database.
Never instantiated directly; see FloodfillNetworkDatabaseFacade.
-
Field Summary
Fields Modifier and Type Field Description protected RouterContext
_context
protected Log
_log
protected int
_networkID
protected PeerSelector
_peerSelector
static String
DEFAULT_DB_DIR
static long
DONT_FAIL_PERIOD
For 10 minutes after startup, don't fail db entries so that if we were offline for a while, we'll have a chance of finding some live peers with the previous references(package private) static int
MAX_EXPLORE_QUEUE
Maximum number of peers to place in the queue to exploreprotected static int
MIN_REMAINING_ROUTERS
If we have less than this many routers left, don't drop any more, even if they're failing or doing bad stuff.(package private) static int
MIN_RESEED
Reseed if below this.(package private) static String
PROP_BUCKET_SIZE
static String
PROP_DB_DIR
(package private) static String
PROP_EXPLORE_QUEUE
(package private) static String
PROP_KAD_B
(package private) static String
PROP_MIN_ROUTER_VERSION
(package private) static String
PROP_ROUTER_INFO_EXPIRATION_ADJUSTED
(package private) static String
PROP_VALIDATE_ROUTERS_AFTER
protected static long
PUBLISH_JOB_DELAY
This needs to be long enough to give us time to start up, but less than 20m (when we start accepting tunnels and could be a IBGW) Actually no, we need this soon if we are a new router or other routers have forgotten about us, else we can't build IB exploratory tunnels. -
Constructor Summary
Constructors Constructor Description KademliaNetworkDatabaseFacade(RouterContext context)
-
Method Summary
Modifier and Type Method Description protected void
createHandlers()
unused, see overrideprotected abstract PeerSelector
createPeerSelector()
(package private) void
dropAfterLookupFailed(Hash peer)
Final remove for a router info.void
fail(Hash dbEntry)
Final remove for a leaseset.(package private) void
failPermanently(Destination dest)
Negative cache until restartSet<Hash>
findNearestRouters(Hash key, int maxNumRouters, Set<Hash> peersToIgnore)
Get the routers closest to that key in response to a remote lookup Only used by ../HDLMJ Set MAY INCLUDE our own router - add to peersToIgnore if you don't wantSet<Hash>
getAllRouters()
get the hashes for all known routersList<BlindData>
getBlindData()
For console ConfigKeyringHelperBlindData
getBlindData(SigningPublicKey spk)
(package private) DataStore
getDataStore()
(package private) String
getDbDir()
Set<Hash>
getExploreKeys()
(package private) KBucketSet<Hash>
getKBuckets()
protected int
getKBucketSetSize()
This is fast and doesn't use synchronization, but it includes both routerinfos and leasesets.int
getKnownLeaseSets()
This is only used by StatisticsManager to publish the count if we are floodfill.int
getKnownRouters()
This used to return the number of routers that were in both the kbuckets AND the data store, which was fine when the kbuckets held everything.(package private) long
getLastExploreNewDate()
long
getLastRouterInfoPublishTime()
The last time we successfully published our RI.Set<LeaseSet>
getLeases()
public for NetDbRenderer in routerconsolePeerSelector
getPeerSelector()
int
getPeerTimeout(Hash peer)
todo: does this need more tuning?Set<RouterInfo>
getRouters()
public for NetDbRenderer in routerconsoleboolean
isInitialized()
(package private) boolean
isNegativeCached(Hash key)
Is the key in the negative lookup cache?boolean
isNegativeCachedForever(Hash key)
Is it permanently negative cached?protected void
lookupBeforeDropping(Hash peer, RouterInfo info)
don't use directly - see F.N.D.F.void
lookupDestination(Hash key, Job onFinishedJob, long timeoutMs, Hash fromLocalDest)
Lookup using the client's tunnels Succeeds even if LS validation and store fails due to unsupported sig type, expired, etc.Destination
lookupDestinationLocally(Hash key)
Lookup locally in netDB and in badDest cache Succeeds even if LS validation fails due to unsupported sig type, expired, etc.(package private) void
lookupFailed(Hash key)
Increment in the negative lookup cachevoid
lookupLeaseSet(Hash key, Job onFindJob, Job onFailedLookupJob, long timeoutMs)
Lookup using exploratory tunnels.void
lookupLeaseSet(Hash key, Job onFindJob, Job onFailedLookupJob, long timeoutMs, Hash fromLocalDest)
Lookup using the client's tunnels Use lookupDestination() if you don't need the LS or don't need it validated.LeaseSet
lookupLeaseSetLocally(Hash key)
Use lookupDestination() if you don't need the LS or don't need it validated.void
lookupLeaseSetRemotely(Hash key, Hash fromLocalDest)
Unconditionally lookup using the client's tunnels.void
lookupLeaseSetRemotely(Hash key, Job onFindJob, Job onFailedLookupJob, long timeoutMs, Hash fromLocalDest)
Unconditionally lookup using the client's tunnels.DatabaseEntry
lookupLocally(Hash key)
DatabaseEntry
lookupLocallyWithoutValidation(Hash key)
Not for use without validationvoid
lookupRouterInfo(Hash key, Job onFindJob, Job onFailedLookupJob, long timeoutMs)
RouterInfo
lookupRouterInfoLocally(Hash key)
This will return immediately with the result or null.void
publish(LeaseSet localLeaseSet)
void
publish(RouterInfo localRouterInfo)
Stores to local db only.void
queueForExploration(Collection<Hash> keys)
boolean
removeBlindData(SigningPublicKey spk)
For console ConfigKeyringHelpervoid
removeFromExploreKeys(Collection<Hash> toRemove)
void
renderStatusHTML(Writer out)
Debug info, HTML formattedvoid
rescan()
ReseedChecker
reseedChecker()
void
restart()
Perform a soft restart.(package private) void
routerInfoPublishSuccessful()
Set the last time we successfully published our RI.void
routingKeyChanged()
Notify the netDB that the routing key changed at midnight UTC(package private) SearchJob
search(Hash key, Job onFindJob, Job onFailedLookupJob, long timeoutMs, boolean isLease)
Begin a kademlia style search for the key specified, which can take up to timeoutMs and will fire the appropriate jobs on success or timeout (or if the kademlia search completes without any match) Unused - called only by FNDF.searchFull() from FloodSearchJob which is overridden - don't use this.(package private) SearchJob
search(Hash key, Job onFindJob, Job onFailedLookupJob, long timeoutMs, boolean isLease, Hash fromLocalDest)
Unused - see FNDF(package private) void
searchComplete(Hash key)
The search for the given key is no longer activeabstract void
sendStore(Hash key, DatabaseEntry ds, Job onSuccess, Job onFailure, long sendTimeout, Set<Hash> toIgnore)
unused (overridden in FNDF)void
setBlindData(BlindData bd)
(package private) void
setLastExploreNewDate(long when)
void
shutdown()
Instruct the service that the router is shutting down and that it should do whatever is necessary to go down gracefully.void
startup()
Instruct the service that it should start normal operation.(package private) void
stopPublishing(Hash target)
LeaseSet
store(Hash key, LeaseSet leaseSet)
Store the leaseSet.RouterInfo
store(Hash key, RouterInfo routerInfo)
Store the routerInfo.(package private) RouterInfo
store(Hash key, RouterInfo routerInfo, boolean persist)
Store the routerInfo.void
unpublish(LeaseSet localLeaseSet)
(package private) String
validate(RouterInfo routerInfo)
Determine whether this routerInfo will be accepted as valid and current given what we know now.
-
Field Details
-
_log
-
_peerSelector
-
_context
-
_networkID
protected final int _networkID -
PROP_MIN_ROUTER_VERSION
- See Also:
- Constant Field Values
-
DONT_FAIL_PERIOD
public static long DONT_FAIL_PERIODFor 10 minutes after startup, don't fail db entries so that if we were offline for a while, we'll have a chance of finding some live peers with the previous references -
PROP_DB_DIR
- See Also:
- Constant Field Values
-
DEFAULT_DB_DIR
- See Also:
- Constant Field Values
-
MIN_RESEED
static final int MIN_RESEEDReseed if below this.- Since:
- 0.9.4
- See Also:
- Constant Field Values
-
MIN_REMAINING_ROUTERS
protected static final int MIN_REMAINING_ROUTERSIf we have less than this many routers left, don't drop any more, even if they're failing or doing bad stuff. As of 0.9.4, we make this LOWER than the min for reseeding, so a reseed will be forced if necessary.- See Also:
- Constant Field Values
-
PROP_ROUTER_INFO_EXPIRATION_ADJUSTED
- See Also:
- Constant Field Values
-
PROP_VALIDATE_ROUTERS_AFTER
- See Also:
- Constant Field Values
-
PUBLISH_JOB_DELAY
protected static final long PUBLISH_JOB_DELAYThis needs to be long enough to give us time to start up, but less than 20m (when we start accepting tunnels and could be a IBGW) Actually no, we need this soon if we are a new router or other routers have forgotten about us, else we can't build IB exploratory tunnels. Unused.- See Also:
- Constant Field Values
-
MAX_EXPLORE_QUEUE
static final int MAX_EXPLORE_QUEUEMaximum number of peers to place in the queue to explore- See Also:
- Constant Field Values
-
PROP_EXPLORE_QUEUE
- See Also:
- Constant Field Values
-
PROP_BUCKET_SIZE
- See Also:
- Constant Field Values
-
PROP_KAD_B
- See Also:
- Constant Field Values
-
-
Constructor Details
-
Method Details
-
searchComplete
The search for the given key is no longer active -
isInitialized
public boolean isInitialized()- Overrides:
isInitialized
in classNetworkDatabaseFacade
-
createPeerSelector
-
getPeerSelector
-
reseedChecker
- Overrides:
reseedChecker
in classNetworkDatabaseFacade
- Since:
- 0.9
-
getKBuckets
KBucketSet<Hash> getKBuckets() -
getDataStore
DataStore getDataStore() -
getLastExploreNewDate
long getLastExploreNewDate() -
setLastExploreNewDate
void setLastExploreNewDate(long when) -
getExploreKeys
- Returns:
- unmodifiable set
-
removeFromExploreKeys
-
queueForExploration
-
shutdown
public void shutdown()Description copied from interface:Service
Instruct the service that the router is shutting down and that it should do whatever is necessary to go down gracefully. It should not depend on other components at this point. This call DOES block. -
restart
public void restart()Description copied from interface:Service
Perform a soft restart. -
rescan
public void rescan()- Overrides:
rescan
in classNetworkDatabaseFacade
-
getDbDir
String getDbDir() -
startup
public void startup()Description copied from interface:Service
Instruct the service that it should start normal operation. This call DOES block until the service is ready. -
createHandlers
protected void createHandlers()unused, see override -
findNearestRouters
Get the routers closest to that key in response to a remote lookup Only used by ../HDLMJ Set MAY INCLUDE our own router - add to peersToIgnore if you don't want- Specified by:
findNearestRouters
in classNetworkDatabaseFacade
- Parameters:
key
- the real key, NOT the routing keypeersToIgnore
- can be nullmaxNumRouters
- The maximum number of routers to return
-
getAllRouters
get the hashes for all known routers- Specified by:
getAllRouters
in classNetworkDatabaseFacade
-
getKnownRouters
public int getKnownRouters()This used to return the number of routers that were in both the kbuckets AND the data store, which was fine when the kbuckets held everything. But now that is probably not what you want. Just return the count in the data store.- Overrides:
getKnownRouters
in classNetworkDatabaseFacade
-
getKnownLeaseSets
public int getKnownLeaseSets()This is only used by StatisticsManager to publish the count if we are floodfill. So to hide a clue that a popular eepsite is hosted on a floodfill router, only count leasesets that are "received as published", as of 0.7.14- Overrides:
getKnownLeaseSets
in classNetworkDatabaseFacade
-
getKBucketSetSize
protected int getKBucketSetSize()This is fast and doesn't use synchronization, but it includes both routerinfos and leasesets. Use it to avoid deadlocks. No - not true - the KBS contains RIs only. -
getBlindData
- Overrides:
getBlindData
in classNetworkDatabaseFacade
- Parameters:
spk
- unblinded key- Returns:
- BlindData or null
- Since:
- 0.9.40
-
setBlindData
- Overrides:
setBlindData
in classNetworkDatabaseFacade
- Parameters:
bd
- new BlindData to put in the cache- Since:
- 0.9.40
-
getBlindData
For console ConfigKeyringHelper- Overrides:
getBlindData
in classNetworkDatabaseFacade
- Since:
- 0.9.41
-
removeBlindData
For console ConfigKeyringHelper- Overrides:
removeBlindData
in classNetworkDatabaseFacade
- Parameters:
spk
- the unblinded public key- Returns:
- true if removed
- Since:
- 0.9.41
-
routingKeyChanged
public void routingKeyChanged()Notify the netDB that the routing key changed at midnight UTC- Overrides:
routingKeyChanged
in classNetworkDatabaseFacade
- Since:
- 0.9.50
-
lookupLocally
- Specified by:
lookupLocally
in classNetworkDatabaseFacade
- Returns:
- RouterInfo, LeaseSet, or null, validated
- Since:
- 0.8.3
-
lookupLocallyWithoutValidation
Not for use without validation- Specified by:
lookupLocallyWithoutValidation
in classNetworkDatabaseFacade
- Returns:
- RouterInfo, LeaseSet, or null, NOT validated
- Since:
- 0.9.9, public since 0.9.38
-
lookupLeaseSet
Lookup using exploratory tunnels. Use lookupDestination() if you don't need the LS or don't need it validated.- Specified by:
lookupLeaseSet
in classNetworkDatabaseFacade
-
lookupLeaseSet
public void lookupLeaseSet(Hash key, Job onFindJob, Job onFailedLookupJob, long timeoutMs, Hash fromLocalDest)Lookup using the client's tunnels Use lookupDestination() if you don't need the LS or don't need it validated.- Specified by:
lookupLeaseSet
in classNetworkDatabaseFacade
- Parameters:
fromLocalDest
- use these tunnels for the lookup, or null for exploratory- Since:
- 0.9.10
-
lookupLeaseSetRemotely
Unconditionally lookup using the client's tunnels. No success or failed jobs, no local lookup, no checks. Use this to refresh a leaseset before expiration.- Specified by:
lookupLeaseSetRemotely
in classNetworkDatabaseFacade
- Parameters:
fromLocalDest
- use these tunnels for the lookup, or null for exploratory- Since:
- 0.9.25
-
lookupLeaseSetRemotely
public void lookupLeaseSetRemotely(Hash key, Job onFindJob, Job onFailedLookupJob, long timeoutMs, Hash fromLocalDest)Unconditionally lookup using the client's tunnels.- Specified by:
lookupLeaseSetRemotely
in classNetworkDatabaseFacade
- Parameters:
fromLocalDest
- use these tunnels for the lookup, or null for exploratoryonFindJob
- may be nullonFailedLookupJob
- may be null- Since:
- 0.9.47
-
lookupLeaseSetLocally
Use lookupDestination() if you don't need the LS or don't need it validated.- Specified by:
lookupLeaseSetLocally
in classNetworkDatabaseFacade
-
lookupDestination
Lookup using the client's tunnels Succeeds even if LS validation and store fails due to unsupported sig type, expired, etc. Note that there are not separate success and fail jobs. Caller must call lookupDestinationLocally() in the job to determine success.- Specified by:
lookupDestination
in classNetworkDatabaseFacade
- Parameters:
onFinishedJob
- non-nullfromLocalDest
- use these tunnels for the lookup, or null for exploratory- Since:
- 0.9.16
-
lookupDestinationLocally
Lookup locally in netDB and in badDest cache Succeeds even if LS validation fails due to unsupported sig type, expired, etc.- Specified by:
lookupDestinationLocally
in classNetworkDatabaseFacade
- Since:
- 0.9.16
-
lookupRouterInfo
- Specified by:
lookupRouterInfo
in classNetworkDatabaseFacade
-
lookupRouterInfoLocally
This will return immediately with the result or null. However, this may still fire off a lookup if the RI is present but expired (and will return null). This may result in deadlocks. For true local only, use lookupLocallyWithoutValidation()- Specified by:
lookupRouterInfoLocally
in classNetworkDatabaseFacade
-
publish
- Specified by:
publish
in classNetworkDatabaseFacade
- Throws:
IllegalArgumentException
- if the leaseSet is not valid
-
stopPublishing
-
publish
Stores to local db only. Overridden in FNDF to actually send to the floodfills.- Specified by:
publish
in classNetworkDatabaseFacade
- Throws:
IllegalArgumentException
- if the local router info is invalid
-
routerInfoPublishSuccessful
void routerInfoPublishSuccessful()Set the last time we successfully published our RI.- Since:
- 0.9.9
-
getLastRouterInfoPublishTime
public long getLastRouterInfoPublishTime()The last time we successfully published our RI.- Overrides:
getLastRouterInfoPublishTime
in classNetworkDatabaseFacade
- Since:
- 0.9.9
-
store
Store the leaseSet. If the store fails due to unsupported crypto, it will negative cache the hash until restart.- Specified by:
store
in classNetworkDatabaseFacade
- Returns:
- previous entry or null
- Throws:
IllegalArgumentException
- if the leaseSet is not validUnsupportedCryptoException
- if that's why it failed.
-
validate
Determine whether this routerInfo will be accepted as valid and current given what we know now. Call this before each use, to check expiration- Returns:
- reason why the entry is not valid, or null if it is valid
- Throws:
IllegalArgumentException
- Since:
- 0.9.7
-
store
Store the routerInfo. If the store fails due to unsupported crypto, it will banlist the router hash until restart and then throw UnsupportedCrytpoException.- Specified by:
store
in classNetworkDatabaseFacade
- Returns:
- previous entry or null
- Throws:
IllegalArgumentException
- if the routerInfo is not validUnsupportedCryptoException
- if that's why it failed.
-
store
Store the routerInfo. If the store fails due to unsupported crypto, it will banlist the router hash until restart and then throw UnsupportedCrytpoException.- Returns:
- previous entry or null
- Throws:
IllegalArgumentException
- if the routerInfo is not validUnsupportedCryptoException
- if that's why it failed.
-
fail
Final remove for a leaseset. For a router info, will look up in the network before dropping.- Specified by:
fail
in classNetworkDatabaseFacade
-
lookupBeforeDropping
don't use directly - see F.N.D.F. override -
dropAfterLookupFailed
Final remove for a router info. Do NOT use for leasesets. -
unpublish
- Specified by:
unpublish
in classNetworkDatabaseFacade
-
search
Begin a kademlia style search for the key specified, which can take up to timeoutMs and will fire the appropriate jobs on success or timeout (or if the kademlia search completes without any match) Unused - called only by FNDF.searchFull() from FloodSearchJob which is overridden - don't use this.- Throws:
UnsupportedOperationException
- always
-
search
SearchJob search(Hash key, Job onFindJob, Job onFailedLookupJob, long timeoutMs, boolean isLease, Hash fromLocalDest)Unused - see FNDF- Throws:
UnsupportedOperationException
- always- Since:
- 0.9.10
-
getLeases
public for NetDbRenderer in routerconsole- Overrides:
getLeases
in classNetworkDatabaseFacade
-
getRouters
public for NetDbRenderer in routerconsole- Overrides:
getRouters
in classNetworkDatabaseFacade
-
getPeerTimeout
todo: does this need more tuning? -
sendStore
public abstract void sendStore(Hash key, DatabaseEntry ds, Job onSuccess, Job onFailure, long sendTimeout, Set<Hash> toIgnore)unused (overridden in FNDF) -
lookupFailed
Increment in the negative lookup cache- Parameters:
key
- for Destinations or RouterIdentities- Since:
- 0.9.4 moved from FNDF to KNDF in 0.9.16
-
isNegativeCached
Is the key in the negative lookup cache?- Parameters:
key
- for Destinations or RouterIdentities- Since:
- 0.9.4 moved from FNDF to KNDF in 0.9.16
-
failPermanently
Negative cache until restart- Since:
- 0.9.16
-
isNegativeCachedForever
Is it permanently negative cached?- Overrides:
isNegativeCachedForever
in classNetworkDatabaseFacade
- Parameters:
key
- only for Destinations; for RouterIdentities, see Banlist- Since:
- 0.9.16
-
renderStatusHTML
Debug info, HTML formatted- Specified by:
renderStatusHTML
in interfaceService
- Overrides:
renderStatusHTML
in classNetworkDatabaseFacade
- Throws:
IOException
- Since:
- 0.9.10
-