Networking and Distributed Systems

Autonomic Computing

• The Dawning of the Autonomic Computing Era (IBM Systems Journal 2003)
  • Outlines need for autonomic computing, some basic necessary components
• A Survey of Autonomic Computing: Degrees, Models, and Applications (ACM CSUR 2008)
  • Tries to survey autonomous computing and argue that it's not just hype and rebranding, but presents mostly rebranded examples...

Content-Centric Networking

• Networking Named Content (CoNEXT 2009)
  • Introduces CCN, which shifts core networking primitives to secured, named packets.
• VoCCN: Voice over Content-Centric Networks (WRAI 2009)
  • Applies CCN to voice streaming.
• Content-Based Publish/Subscribe Networking and Information-Centric Networking (ICN 2011)
  • Architecture combining on-demand and pub/sub over shared CCN structures.

Declarative Networking

• Declarative Policy-Based Adaptive MANET Routing (ICNP 2009)
  • Adaptive selection of declaratively specified MANET routing protocols.

Delay Tolerant Networking

• Probabilistic Routing in Intermittently Connected Networks (SAPIR 2004)
  • Introduces PROPHET probabilistic connectivity estimation routing for DTN.

Distributed Hashtables

• Kademlia: A Peer-to-Peer Information System Based on the XOR Metric (P2P 2002)
  • Overviews the Kademlia DHT, based around sniffed bucket lists of nodes organized by XOR distance.
• Approximate Matching for Peer-to-Peer Overlays with Cubit (Cornell 2008)
  • Overviews Cubit, a framework and BitTorrent plugin for approximate matching in DHTs.
• Hyperspaces for Object Clustering and Approximate Matching in Peer-to-Peer Overlays (Hot OS 2007)
  • Overviews e-llama, a framework for approximate matching in DHTs.
• On the Feasibility of Peer-to-Peer Web Indexing and Search (P2P 2003)
  • Discusses viability of typical object pointer keyword replication approach to search in DHTs.
• Superstring: A Scalable Service Discovery Protocol for the Wide-Area Pervasive Environment (ICON 2003)
  • Distributed hashtable based service discovery.
• Chord: A Scalable Peer-to-Peer Lookup Service for Internet Applications (SIGCOMM 2001)
  • Chord.
• Looking Up Data in P2P Systems (CACM 2003)
  • Overviews several of the prototypical DHTs.
• A Performance vs. Cost Framework for Evaluating DHT Design Tradeoffs Under Churn (INFOCOM 2005)
  • Simulation analysis of the efficiency of several different DHTs under varying churn and workload.

Epidemic and Gossip Protocols

• Epidemic Algorithms for Replicated Database Maintenance (PDC 1987)
  • Introduces and analyzes dissemination and consistency maintenance protocols based on epidemiology.
• Trickle: A Self-Regulating Algorithm for Code Propagation and Maintenance in Wireless Sensor Networks (NSDI 2004)
  • Introduces Trickle, a gossip protocol for data consistency maintenance on sensor networks which takes advantage of the broadcast medium and eavesdropping.
• The Emergence of a Networking Primitive in Wireless Sensor Networks (CACM 2008)
  • Trickle.
• A Gossip Protocol for Subgroup Multicast (IWARGC 2001)
  • Describes abstract scheme varying infectivity and susceptibility to have nodes participate in gossip process at varying rates.
• Prioritized Epidemic Routing for Opportunistic Networks (WMON 2007)
  • Trying to maximize probability of bundles being available when near-destination links are available.

Eventual Consistency

• Eventually Consistent (CACM 2009)
  • Describes different forms of consistency, and the changing approaches taken from early database systems to Internet scale services.
• A Comprehensive Study of Convergent and Commutative Replicated Data Types (INRIA 2011)
  • Overview of CRDTs, with definitions and portfolio of examples.
• Dotted Version Vectors: Logical Clocks for Optimistic Replication (arXiv 2010)
  • Minimized update causality tracking.

Fault Detection/Management

• On the Design of a Self-Managed Wireless Sensor Network (IEEE Communications 2005)
  • Very high level overview of an autonomic control system for a fire detecting wireless sensor network.
• Self-Managed Fault Management in Wireless Sensor Networks (UBICOMM 2008)
  • High level discussion of hardware monitoring and failure detection in a hierarchical sensor network.
• Fault Localization and Self-Healing with Dynamic Domain Configuration (MILCOM 2003)
  • Applying Bayesian models and incremental hypothesis updating to detecting faults, resolving them by reconfiguring network to isolate problems or start new services.
• Active Probing Approach for Fault Localization in Computer Networks (E2EMON 2006)
  • Selecting probe stations, types, and strategies to detect and localize faults on a network.
• Diagnosis of Sensor Networks (ICC 2001)
  • Several basic approaches to collect information from sensor networks to discover faulty nodes.
• Distributed Fault Detection of Wireless Sensor Networks (DIWANS 2006)
  • Voting among neighbors to determine faulty sensors based on reported values.

Messaging Middleware

• Streaming XML with Jabber/XMPP (IC 2005)
  • Brief overview of XMPP; pretty high level.
• Extensible Messaging and Presence Protocol (XMPP): Core (IETF 2004)
  • Core session control and messaging structure for XMPP
• XO: XMPP Overlay Service for Distributed Chat (MILCOM 2010)
  • Proxies and gateways for XMPP on tactical edge/MANET.
• Kafka: A Distributed Messaging System for Log Processing (NetDB 2011)
  • Initial introduction of LinkedIn's data streaming platform.

Military/Tactical Networks

• Comparative Review of Commercial vs Tactical Wireless Networks (IEEE Communications 2010)
  • Discusses why military networks haven't kept pace w/ commercial efforts, good example of military network structure.
• Architecture and Applications of Dynamic Survivable Resource Pooling in Battlefield Networks (SPIE 2004)
  • Constructs CDS of forwarders and name resolvers for service discovery.
• DARPA Progress Towards Affordable, Dense, and Content Focused Tactical Edge Networks (MILCOM 2008)
  • Overview of goals of WNaN program.
• Key Challenges of Military Tactical Networking and the Elusive Promise of MANET Technology (IEEE Communications 2006)
  • Discusses basic problems in tactical edge networking.
• SPEYES: Sensing and Patrolling Enablers Yielding Effective SASO (Aerospace 2005)
  • Constructs a simulation of SASO operations to argue the utility of SPEYES system components.

Mobile Ad Hoc and Mesh Networks

• Exploring Mesh and Tree Based Multicast Routing Protocols for MANETs (IEEE Mobile Computing 2006)
  • Evaluates ODMRP and MAODV protocols in various settings---ODMRP shown to have better delivery, MAODV less overhead; looks at variations on flooding to enable alternately reduced redundancy or improved reliability
• A High-Throughput Path Metric for Multi-Hop Wireless Routing (Wireless 2005)
  • Introduces ETX, estimated transmission count, for choosing higher quality paths of more hops versus inferior paths of less hops.
• Architecture and Evaluation of an Unplanned 802.11b Mesh Network (MobiCom 2005)
  • Overviews and evaluates Roofnet algorithms and implementation.
• A High-Throughput Path Metric for Multi-Hop Wireless Routing (MobiCom 2003)
  • Introduces ETX link quality estimation.
• Communications Middleware for Tactical Environments: Observations, Experiences, and Lessons Learned (IEEE Communications 2009)
  • Presents the myriad networking challenges faced in tactical/MANET settings.
• Intelligent Content Transformation in Tatical Wireless Networks (MILCOM 2010)
  • Application aware data reduction to gracefully degrade services rather than kicking people off.
• Intelligent Application Persistence in Tactical Wireless Networks (MILCOM 2010)
  • Simple scheme to cache and replay different types of media to recover from disruption.
• Mobile Ad Hoc Networking and the IETF (SIGMOBILE 2006)
  • Overviews the status of a number of IETF MANET WG initiatives.

Network Management

• Performance Analysis of DRAMA: A Distributed Policy-Based System for MANET Management (MILCOM 2006)
  • Very high level overview of DRAMA agent-based management scheme; focus on software-in-the-loop evaluation on emulated MANET compared to SNMP.
• Performance Metrics for All (IEEE IC 2009)
  • Quickly reviews abstract elements of (IP network related) performance metrics, their construction, and their use
• A Distributed Information Repository for Autonomic Context-Aware MANETs
  • Describes some simple but detailed middleware for collecting and providing access to cross-layer information.
• Using Ontologies to Simplify Wireless Network Configuration (FOMI 2005)
  • Constructs simple frame logic object ontology to capture MIB data.
• Ontology Mapping for the Interoperability Problem in Network Management (JSAC 2005)
  • Constructs ontology of network configuration, defines similarity measures and ontology alignment process for FOL concepts.
• HYWINMARC: An Autonomic Management Architecture for Hybrid Wireless Networks (LNCS 2006)
  • Policy managing mobile agents on wireless mesh network with MANET clusters.
• FOCALE---A Novel Autonomic Networking Architecture (ITSSA 2007)
  • High level architecture for ontology based integration and autonomic control of network elements.

Network Routing ^netrouting

• Virtual Ring Routing: Network Routing Inspired by DHTs (SIGCOMM 2006)
  • Network routing a DHT, as opposed to an overlay.
• Core Based Trees (CBT) (SIGCOMM 1993)
  • Construction and maintenance of multicast routing trees.
• Distance Vector Multicast Routing Protocol (IETF 1988)
  • Construction and maintenance of multicast routing trees.
• The PIM Architecture for Wide-Area Multicast Routing (ToN 1996)
  • Overviews PIM, which supports multicast for dense and sparse groups.
• Multicast Extensions to OSPF (IETF 1994)
  • Overviews MOSPF, link state based multicast over OSPF.
• Host Extensions for IP Multicasting (IETF 1989)
  • Basic multicast addressing and operation.
• Maximizing the Probability of Delivery of Multipoint Relay Broadcast Protocol in Wireless Ad Hoc Networks with a Realistic Physical Layer (MSN 2006)
  • Extending MPR scheme to improve probability of receipt by relays.
• Multipoint Relaying for Flooding Broadcast Messages in Mobile Wireless Networks (HICSS 2002)
  • Multi-point relaying for optimized forwarding in MANETs.
• Optimized Link State Routing Protocol for Ad Hoc Networks (INMIC 2001)
  • Introduces OLSR.
• Multicast Operation of the Ad-Hoc On-Demand Distance Vector Routing Protocol (Mobicom 1999)
  • MAODV.
• Ad-Hoc On-Demand Distance Vector Routing (WMCSA 1999)
  • AODV.
• Simplified Multicast Forwarding in Mobile Ad Hoc Networks (MILCOM 2005)
  • SMF.
• Comparison of Broadcasting Techniques for Mobile Ad Hoc Networks (SMANETC 2002)
  • Investigates a number of general approaches to broadcasting in MANETs
• Source-Tree Routing in Wireless Networks (ICNP 1999)
  • MANET routing.

Parallel Computing

• The Revolution Inside the Box (CACM 2008)
  • Multi-core processors in changing both hardware and software in radical ways.
• Maximizing Power Efficiency with Asymmetric Multicore Systems (CACM 2009)
  • Optimizing scheduling of CPU intensive and parallel, memory intensive processes across high speed, high power and low speed, low power asymmetric multicores
• Scalable Synchronous Queues (CACM 2009)
  • Presents two algorithms for lock free synchronous queues, since adopted for thread scheduling in Java 6. Synchronous queues pair producers with consumers, synchronizing their activities and eliminating the need for a work product buffer.
• Transactional Memory (CACM 2008)
  • Providing similar kinds of guarantees for shared memory as standard transactional DBs.

Peer to Peer

• An Analysis of Internet Content Delivery Systems (OSDI 2002)
  • Analyzes network traffic at UW to look at P2P vs Web behavior, discusses applicability of P2P caches
• An Introduction to Communication Network Analysis, Chapter 7 (Wiley-IEEE 2007)
  • Quickly overviews several basic, common elements in P2P search
• RDFPeers: A Scalable Distributed {RDF} Repository Based on a Structured Peer-to-peer Network (WWW 2004)
  • Presents a scheme for distributing RDF triple stores through a reasonably simple scheme of pushing three copies, one each for pred/sub/obj, into a DHT, and querying in a straightforward way based on that
• PlanetP: Using Gossiping to Build Content Addressable Peer-to-Peer Information Sharing Communities
  • Overviews a P2P system for keyword search document retrieval built on gossiping and Bloom filters.
• Peer-to-Peer Communications for Tactical Environments: Observations, Requirements, and Experiences (IEEE Communications 2010)
  • Overviews some requirements in tactical edge networking and P2P's abilities to meet them.
• A Cross-layer Decentralized BitTorrent for Mobile Ad Hoc Networks (MobiQuitous workshop 2006)
  • Basic modifications to BitTorrent to decentralize for MANET environments.
• CodeTorrent: Content Distribution Using Network Coding in VANET (MobiShare 2006)
  • Describes simple protocol for file sharing based on network coding in VANETs
• Attacking a Swarm with a Band of Liars: Evaluating the Impact of Attacks on BitTorrent (P2P 2007)
  • Looks at attacks intended to deny availability of content on BitTorrent.

Platforms

• Challenges and Lessons in Developing Middleware on Smart Phones (IEEE Computer 2008)
  • Overviews limitations of current smart phone platforms, middleware requirements.

Publish/Subscribe ^pubsub

• The Many Faces of Publish/Subscribe (ACM CS 2003)
  • Looks at several variants of pub/sub (e.g. topic, content, type) as well as similar schemes (e.g. RPC) and looks at how they enable decoupling participants in time/space/synchronization
    • These slides seem largely based on this paper & have some good figures/tables: http://www.extreme.indiana.edu/~gannon/b649/IntroToPublishSubscribe.ppt
• Disseminating Information to Mobile Clients Using Publish–Subscribe (IEEE IC 2004)
  • Overviews the Rebeca pub/sub system, which incorporates several mechanisms to support mobile users, including filter aggregation, reliable and persistent delivery, and several levels of QoS policies
• An Ontology-Based Publish/Subscribe System (Middleware 2004)
  • Uses a simple homed graph pattern matching scheme on central registrar to compare pubs to subs; no use of inference
• Semantic Email Addressing (IEEE IC 2009)
  • Sending emails to queries over Semantic Web data which database resolves to sets of users.
• A Survey of Application Level Multicast Techniques (CC 2004)
  • Overviews several systems for multicast overlay networks.
• Towards an Internet-Scale XML Dissemination Service (VLDB 2004)
  • Tree of XML routers for content distribution, in-network data reduction.
• PastryStrings: A Comprehensive Content-Based Publish/Subscribe DHT Network (ICDCS 2006)
  • Overviews a scheme for string and numeric comparisons over a DHT.
• Scribe: The Design of a Large-Scale Event Notification Infrastructure (NGC 2001)
  • A relatively straightforward multicast DHT topic-based pub/sub system.
• Publish/Subscribe on Top of DHT Using RETE Algorithm (FIS 2010)
  • Natural scheme to distribute Rete network over a DHT, with particular application to pub/sub.
• Building Content-Based Publish/Subscribe Systems with Distributed Hash Tables (DISP2PC 2003)
  • Morphs content-based pub/sub into topic-based pub/sub over DHT by applying templates extracting indexing features.
• Application-Level Multicast Using Content-Addressable Networks (NGC 2001)
  • Uses CAN to provide group communications.
• OMG Data-Distribution Service: Architectural Overview (DCSW 2003)
  • Overviews the OMG Data Distribution Service (DDS).
• SelectCast: A Scalable and Self-Repairing Multicast Overlay Routing Facility (WSSRS 2003)
  • Multicast overlay protocol.
• Tree Pattern Aggregation for Scalable XML Data Dissemination (VLDB 2002)
  • Filters described using tree patterns, a subset of XPath
• Publish-Subscribe Tree Maintenance over a DHT (DEBS 2005)
  • Using DHT to mitigate pub/sub disruptions.
• Astrolabe: A Robust and Scalable Technology for Distributed System Monitoring, Management, and Data Mining (TCS 2003)
  • About system management, but really about widescale data collection.
• Willow: DHT, Aggregation, and Publish/Subscribe in One Protocol (WPPS 2004)
  • Pub/sub over DHTs.
• A Routing Scheme for Content-Based Networking (INFOCOM 2004)
  • Pub/sub routing scheme combining broadcast tree with interest tree.
• Forwarding in a Content-Based Network (SIGCOMM 2003)
  • Structures for efficient matching of messages and queries.

Sensor Networks

• Irisnet: An Architecture for a Worldwide Sensor Web (IEEE Pervasive 2003)
  • Discussion of Irisnet, a framework for large scale integration of many sensors and users, employing service based computing and distributed databases.
• TAG: A Tiny Aggregation Service for Ad-Hoc Sensor Networks (OSDI 2002)
  • Introduces TAG, a system for aggregating readings in a sensor network.
• Semantic Sensor Web (IEEE IC 2008)
  • Annotating sensor network data with Semantic Web ontology markup to better facilitate querying and data fusion; no real discussion of architecture, but clearly centralized.
• Agent Technologies for Sensor Networks (IEEE IS 2009)
  • Brief, high overview of several sensor systems utilizing agent based approaches, including DCOPs for coordination, and model estimation
• The Collection Tree Protocol (CTP) (TinyOS 2007)
  • TinyOS spec for constructing trees over which to aggregate, collect data.
• The Link Estimation Exchange Protocol (LEEP) (TinyOS 2007)
  • TinyOS spec on calculating link quality.
• The Physical Side of Computing (CACM 2008)
  • Need a complexity theory for energy consumption, much like memory and time.

Software Defined Networks

• Languages for Software-Defined Networks (IEEE Communications 2013)
  • SQL-ish declarative querying for controlling SDNs.
• Nettle: Functional Reactive Programming of OpenFlow Networks (PADL 2011)
  • Haskell based DSL for OpenFlow programming.

Web Services/Service Discovery

• Robust Web Services in Heterogenous Military Networks (IEEE Communications 2010)
  • Difficulties in SOA on disadvantaged, tactical networks, proxies to mitigate.
• Web Services Discovery across Heterogenous Military Networks (IEEE Communications 2010)
  • Gatewaying service discovery across heterogenous networks.
• An Architecture for a Secure Service Discovery Service (Mobicom 1999)
  • Architecture for wide area service discovery in Berkeley Ninja. Significant focus on security.
• INS/Twine: A Scalable Peer-to-Peer Architecture for Intentional Resource Discovery (PC 2002)
  • Takes the INS system and recasts it on top of a DHT for greater scalability.
• The Design and Implementation of an Intentional Naming System (SOSP 1999)
  • Presents INS, a query based mesh system for service discovery.
• A Search-based Network Architecture for Mobile Devices (TechReport 2009)
  • Introduces Haggle, a system for similarity based network discovery/search.

Zero Configuration Networking

• RFC 2608: Service Location Protocol, v2 (IETF 1999)
  • Defines SLP, a protocol for service discovery on LANs.
• RFC 2609: Service Templates and Service: Schemes (IETF 1999)
  • Defines URL conventions for SLP, simple frame system for attribute templates.
• Requirements for a Protocol to Replace AppleTalk NBP (IETF 2010)
  • Overviews AppleTalk's support for service discovery, outlines requirements for matching IP based service.
• Multicast DNS (IETF 2010)
  • Standards track specification for multicast DNS.
• DNS-Based Service Discovery (IETF 2010)
  • Standards track specification for service discovery using DNS.
• Zero Configuration Networking with Bonjour (Google 2005)
  • Overviews Bonjour, zero configuration networking.
• Multicast Service Discovery Profiles for Deployment within Dynamic Edge Networks (MILCOM 2010)
  • Overviews INDI mechanism for service discovery within MANETs.