Verified iptables Firewall Analysis and Verification

Verified iptables Firewall Analysis and Verification J Autom Reasoning (2018) 61:191–242 https://doi.org/10.1007/s10817-017-9445-1 Verified iptables Firewall Analysis and Verification 1 1 1 Cornelius Diekmann · Lars Hupel · Julius Michaelis · 1 1 Maximilian Haslbeck · Georg Carle Received: 31 March 2017 / Accepted: 14 December 2017 / Published online: 3 January 2018 © The Author(s) 2018. This article is an open access publication Abstract This article summarizes our efforts around the formally verified static analysis of iptables rulesets using Isabelle/HOL. We build our work around a formal semantics of the behavior of iptables firewalls. This semantics is tailored to the specifics of the filter table and supports arbitrary match expressions, even new ones that may be added in the future. Around that, we organize a set of simplification procedures and their correctness proofs: we include procedures that can unfold calls to user-defined chains, simplify match expressions, and construct approximations removing unknown or unwanted match expressions. For analysis purposes, we describe a simplified model of firewalls that only supports a single list of rules with limited expressiveness. We provide and verify procedures that translate from the complex iptables language into this simple model. Based on that, we implement the verified generation of IP space partitions and minimal service matrices. An evaluation of our work on a large set of real-world firewall rulesets shows that our framework provides interesting results in many situations, and can both help and out-compete other static analysis frameworks found in related work. This work has been supported by the European Commission, project SafeCloud, Grant 653884; German Federal Ministry of Education and Research (BMBF), EUREKA project SASER, Grant 16BP12304, and SENDATE, Grant 16KIS0472. B Lars Hupel lars.hupel@tum.de Cornelius Diekmann diekmann@net.in.tum.de Julius Michaelis michaeli@in.tum.de Maximilian Haslbeck haslbecm@in.tum.de Georg Carle carle@net.in.tum.de Department of Informatics, Technical University of Munich, Boltzmannstr. 3, Garching bei München, Germany 123 192 C. Diekmann et al. Keywords Computer networks · Firewalls · Isabelle · Netfilter · Iptables · Semantics · Formal verification 1 Introduction Firewalls are a fundamental security mechanism for computer networks. Several firewall solutions, ranging from open source [66,78,79] to commercial [14,37], exist. Operating and managing firewalls is challenging as rulesets are usually written manually. While vulnera- bilities in firewall software itself are comparatively rare, it has been known for over a decade [82] that many firewalls enforce poorly written rulesets. However, the prevalent methodology for configuring firewalls has not changed. Consequently, studies regularly report insufficient quality of firewall rulesets [25,36,47,54,74,81,84–86]. The predominant firewall of Linux is iptables [78]. In general, an iptables ruleset is pro- cessed by the Linux kernel for each packet comparably to a batch program: rules are evaluated sequentially, but the action (sometimes called target) is only applied if the packet matches the criteria of the rule. A list of rules is called a chain. Ultimately, the Linux kernel needs to determine whether to ACCEPT or DROP the packet, hence, those are the common actions. Further possible actions include jumping to other chains and continue processing from there. As an example, we use the firewall rules in Fig. 1, taken from an NAS (network-attached storage) device. The ruleset reads as follows: processing starts at the INPUT chain. In the first rule, all incoming packets are sent directly to the user-defined DOS_PROTECT chain, where some rate limiting is applied. A packet which does not exceed certain limits can make it through this chain without getting DROPped by RETURNing back to the second rule of the INPUT chain. In this second rule, the firewall allows all packets which belong to already ESTABLISHED (or RELATED) connections. This is generally considered good practice. Often, the ESTABLISHED rule accepts most packets and is placed at the beginning of a ruleset for performance reasons. However, it is barely interesting for the actual policy (“who may connect to whom”) enforced by the firewall. The interesting aspect is when a firewall accepts a packet which does not yet belong to an established connection. Once a packet is accepted, further packets for this connection are treated as ESTABLISHED. In the example, Chain INPUT (policy ACCEPT) target prot source destination DOS_PROTECT all 0.0.0.0/0 0.0.0.0/0 ACCEPT all 0.0.0.0/0 0.0.0.0/0 state RELATED,ESTABLISHED DROP tcp 0.0.0.0/0 0.0.0.0/0 tcp dpt:22 DROP tcp 0.0.0.0/0 0.0.0.0/0 multiport dports 21,873,5005,5006,80, ← 548,111,2049,892 DROP udp 0.0.0.0/0 0.0.0.0/0 multiport dports 123,111,2049,892,5353 ACCEPT all 192.168.0.0/16 0.0.0.0/0 DROP all 0.0.0.0/0 0.0.0.0/0 Chain DOS_PROTECT (1 references) target prot source destination RETURN icmp 0.0.0.0/0 0.0.0.0/0 icmptype 8 limit: avg 1/sec burst 5 DROP icmp 0.0.0.0/0 0.0.0.0/0 icmptype 8 RETURN tcp 0.0.0.0/0 0.0.0.0/0 tcp flags:0x17/0x04 limit: avg 1/sec burst 5 DROP tcp 0.0.0.0/0 0.0.0.0/0 tcp flags:0x17/0x04 RETURN tcp 0.0.0.0/0 0.0.0.0/0 tcp flags:0x17/0x02 limit: avg 10000/sec ← burst 100 DROP tcp 0.0.0.0/0 0.0.0.0/0 tcp flags:0x17/0x02 Fig. 1 Linux iptables ruleset of a Synology NAS (network attached storage) device 123 Verified iptables Firewall Analysis and Verification 193 the subsequent rules are the interesting ones which shape the firewall’s connectivity policy. There, some services, identified by their ports, are blocked (and any packets with those destination ports will never create an established connection). Finally, the firewall allows all packets from the local network 192.168.0.0/16 and discards all other packets. Several tools [47–49,54,59,69,80,85] have been developed to ease firewall management and reveal configuration errors. Many tools are not designed for iptables directly, but are based on a generic firewall model. When we tried to analyze real-world iptables firewalls with the publicly available static analysis tools, none of them could handle the rulesets. Even after we simplified the firewall rulesets, we found that tools still fail to analyze our rulesets for the following reasons: – They do not support the vast amount of firewall features, – Their firewall model is too simplistic, – They require the administrator to learn a complex query language which might be more complex than the firewall language itself, – The analysis algorithms do not scale to large firewalls, or – The output of the (unverified) verification tools itself cannot be trusted. To illustrate the problem, we decided to use ITVal [48] because it natively supports iptables, is open source, and supports calls to user-defined chains. However, ITVal’s firewall model is representative of the model used by the majority of tools; therefore, the problems described here also apply to a large class of other tools. Firewall models used in related work are surveyed in Sect. 3.1. We used ITVal to partition the IP space of Fig. 1 into equivalence classes (i.e., ranges with the same access rights) [49]. The expected result is a set of two IP ranges: the local network 192.168.0.0/16 and the “rest”. However, ITVal erroneously only reports one IP range: the universe. Removing the first two rules (in particular the call in the DOS_PROTECT chain) lets ITVal compute the expected result. We identified two concrete issues which prevent tools from “understanding” real-world firewalls. First, calling and returning from custom chains, due to the possibility of complex nested chain calls. Second, more seriously, most tools do not understand the firewall’s match conditions. In the above example, the rate limiting is not understood. An ad-hoc implemen- tation of rate limiting for the respective tool might not be possible, because the underlying algorithm might not be capable of dealing with this special case. Even so, this would not solve the general problem of unknown match conditions. Firewalls, such as iptables, support numerous match conditions and several new ones are added in every release. As of version 1.6.0 (Linux kernel 4.10, early 2017), iptables supports more than 60 match conditions with over 200 individual options. We expect even more match conditions for nftables [79]inthe future since they can be written as simple userspace programs [45]. Therefore, it is virtu- ally impossible to write a tool which understands all possible match conditions. Combined with the fact that in production networks, huge, complex, and legacy firewall rulesets have evolved over time, this poses a particular challenge. Our methodology to tackle this can also be applied to firewalls with simpler semantics, or younger technology with fewer features, e.g., Cisco IOS Access Lists or filtering OpenFlow flow tables (Sect. 15). In this article, we first build a fundamental prerequisite to enable tool-supported analysis of real-world firewalls: we present several steps of semantics-preserving ruleset simplifica- tion, which lead to a ruleset that is “understandable” to subsequent analysis tools: first, we unfold all calls to and returns from user-defined chains. This process is exact and valid for arbitrary match conditions. Afterwards, we process unknown match conditions. For that, we embed a ternary-logic semantics into the firewall’s semantics. Due to ternary logic, all match 123 194 C. Diekmann et al. conditions not understood by subsequent analysis tools can be treated as always yielding an unknown result. In a next step, all unknown conditions can be removed. This introduces an over- and underapproximation ruleset, called upper/lower closure. Guarantees about the original ruleset dropping/allowing a packet can be given by using the respective closure ruleset. To summarize, we provide the following contributions for simplifying iptables rulesets: 1. A formal semantics of iptables packet filtering (Sect. 4) 2. Chain unfolding: transforming a ruleset in the complex chain model to a ruleset in the simple list model (Sect. 5) 3. An embedded semantics with ternary logic, supporting arbitrary match conditions, introducing a lower/upper closure of accepted packets (Sect. 6) 4. Normalization and translation of complex logical expressions to an iptables-compatible format, discovering a meta-logical firewall algebra (Sect. 7) We give a small intermediate evaluation to demonstrate these generic ruleset preprocessing steps (Sect. 8). Afterwards, we use these preprocessing steps to build a fully-verified iptables analysis and verification tool on top. In detail, our further contributions are: 5. A simple firewall model, designed for mathematical beauty and ease of static analysis (Sect. 9) 6. A method to translate real-world firewall rulesets into this simple model (Sect. 10), featuring a series of translation steps to transform, rewrite, and normalize primitive match conditions (Sect. 11) 7. Static and automatic firewall analysis methods, based on the simple model (Sect. 12), featuring – IP address space partitioning – Minimal service matrices 8. Our stand-alone, administrator-friendly tool fffuu (Sect. 13) 9. Evaluation on large real-world data set (Sect. 14) 10. Full formal and machine-verifiable proof of correctness with Isabelle/HOL (Sect. 17) 2 Background: Formal Verification with Isabelle We verified all proofs with Isabelle [63], using its standard Higher-Order Logic (HOL). Isabelle is a proof assistant in the LCF tradition: the system is based on a small and well-established kernel. All higher-level specification and proof tools, e.g., for inductive predicates, functional programs, or proof search, have to go through this kernel. Therefore, the correctness of all obtained results only depends on the correctness of this kernel and the iptables semantics (Fig. 2). The full formalization containing a set of Isabelle theory files is publicly available. An interested reader may consult the detailed (100+ pages) proof document. For brevity, we usually omit proofs in this article, but point the reader with a footnote to the corresponding part of the formalization. Section 17 points the reader to our Isabelle formalization and further accompanying material. Notation. We use pseudo code close to SML and Isabelle. Function application is written without parentheses, e.g., fa denotes function f applied to parameter a.Wewrite :: for prepending a single element to a list, e.g., a :: b :: [c, d]=[a, b, c, d],and ::: for appending lists, e.g., [a, b] ::: [c, d]=[a, b, c, d]. The empty list is written as []. [ fa. a ← l] denotes 123 Verified iptables Firewall Analysis and Verification 195 a list comprehension, i.e., applying f to every element a of list l. [ fx y. x ← l , y ← l ] 1 2 denotes the list comprehension where f is applied to each combination of elements of the lists l and l .For fx y = (x , y), this yields the Cartesian product of l and l . 1 2 1 2 Whenever we refer to specific iptables options or modules, we set them in typewriter font. The iptables options can be looked up in the respective man pages iptables(8) and iptables-extensions(8). 3 Related Work We first survey the common understanding of firewalls in the literature and present specific static firewall analysis tools afterwards. 3.1 Firewall Models Packets are routed through the firewall and the firewall needs to decide whether to allow or deny a packet. The firewall’s ruleset determines its filtering behavior. The firewall inspects its ruleset for each single packet to determine the action to apply to the packet. The ruleset can be viewed as a list of rules; usually it is processed sequentially and the first matching rule is applied. The literature agrees on the definition of a single firewall rule. It consists of a predicate (the match expression) and an action. If the match expression applies to a packet, the action is performed. Usually, a packet is scrutinized by several rules. Zhang et al. [86] specify a com- mon format for packet filtering rules. The action is either “allow” or “deny”, which directly corresponds to the firewall’s filtering decision. The ruleset is processed strictly sequentially, no jumping between chains is possible. Yuan et al. [85] call this the simple list model.ITVal also supports calls to user-defined chains as an action. This allows “jumping” within the ruleset without having a final filtering decision yet. This is called the complex chain model [85]. In general, a packet header is a bitstring which can be matched against [87]. Zhang et al. [86] support matching on the following packet header fields: IP source and destination address, protocol, and port on layer 4. This model is commonly found in the literature [6,9,10,69,85,86]. ITVal extends these match conditions with flags (e.g., TCP SYN)and connection states (INVALID, NEW, ESTABLISHED, RELATED). The state matching is treated as just another match condition. This model is similar to Margrave’s model for IOS [54]. When comparing these features to the simple firewall in Fig. 1, it becomes obvious that none of these tools supports that firewall directly. We are not the first to propose simplifying firewall rulesets to enable subsequent analysis. Brucker et al. [8,10,11] provide algorithms to generate test cases from a firewall policy. A firewall policy in their model is a list of rules on disjoint networks. A rule is a partial function from packets to decisions, e.g., allow or deny. To keep the number of test cases manageable, the firewall ruleset is first simplified while preserving the original behavior. The correctness of Firewalls can be stateful or stateless. Most current firewalls are stateful, which means the firewall remembers and tracks information of previously seen packets, e. g., the TCP connection a packet belongs to and the state of that connection (“conntrack” in iptables parlance). ITVal does not track the state of connections. Match conditions on connection states are treated exactly the same as matches on a packet header. In general, by focusing on rulesets and not firewall implementation, matching on conntrack states is exactly like matching on any other (stateless) condition. However, internally in the firewall, not only the packet header is consulted but also the current connection tables. Note that existing firewall analysis tools also largely ignore state [54]. In our semantics, we also model stateless matching. 123 196 C. Diekmann et al. these transformations is proved with Isabelle/HOL. With regard to low-level firewall features, the instantiation used by Brucker et al. in their evaluation is more limited than the model used by the tools presented above. This is not a limitation since their framework is designed to support different firewall technologies by having a more abstract and generic policy model. Yet, it demonstrates that our tool as a preprocessor to transform low-level iptables rules to a generic firewall model is a useful building block. In general, using our tool as preprocessor can make firewall analysis tools from related work available for iptables. We are not aware of any tool which uses a model fundamentally different than those described here. Our model enhances existing work in that we use ternary logic to support arbitrary match conditions. To analyze a large iptables firewall, the authors of Margrave [54] translated it to basic Cisco IOS access lists [14] by hand. With our simplification, we can automatically remove all features not understood by basic Cisco IOS. This enables translation of any iptables firewall to basic Cisco access lists which is guaranteed to drop no more packets than the original iptables firewall. This opens up all tools available only for Cisco IOS access lists, e.g., Margrave [54] and Header Space Analysis [41]. 3.2 Static Firewall Analysis Tools Popular tools for static firewall analysis include FIREMAN [85], Capretta et al. [13], and the Firewall Policy Advisor [2]. They can use the following features to match on packets: IP addresses, ports, and protocol. However, most real-world firewall rulesets we found in our evaluation use many more features. As can be seen in Fig. 1, among others, iptables supports matching on source IP address, layer 4 port, inbound interface, conntrack state, entries and limits in the recent list. Hence, these tools would not be applicable (without our generic preprocessing) to most firewalls from our evaluation. Most aforementioned tools allow detecting conflicts between rules to uncover configura- tion mistakes. Since our approach rewrites rules to a simpler form and the provenance and relation of the simplified rules to the original ruleset is lost, our approach does not support this. However, we offer service matrices (Sect. 12.2) to provide a general overview of the firewall’s filtering behavior. The work most similar to our static analysis tool, in particular to our IP address space partitioning, is ITVal [48]: it supports a large set of iptables features and can compute an IP address space partition [49]. ITVal, as an academic prototype, only supports IPv4, is not formally verified, and its implementation contains several errors. For example, ITVal produces spurious results if the number of significant bits in IP addresses in CIDR notation [31] is not a multiple of 8. It does not consider logical negations which may occur when RETURNing prematurely from user-defined chains, which leads to wrong interpretation of complement sets. It does not support abstracting over unknown match conditions but simply ignores them, which also leads to spurious results. Anecdotally, we uncovered these corner cases when we tried to prove the correctness of our algorithms and Isabelle was presenting unexpected proof obligations. Without the formal verification, our tool would likely contain similar errors. For rulesets with more than 1000 rules, ITVal requires tens of GBs of memory. We are uncertain whether this is a limitation of its internal data structure or just a simple memory leak. ITVal neither proves the soundness nor the minimality of its IP address range partitioning. Nevertheless, ITVal shows the need for and the use of IP address range partitioning and has demonstrated that its implementation works well on rulesets which do not trigger the Note that the other direction is considered easy [71], because basic Cisco IOS access lists have “no nice features” [32]. Also note that there also are Advanced Access Lists. 123 Verified iptables Firewall Analysis and Verification 197 aforementioned errors. Our tool strongly builds on the ideas of ITVal, but with a different algorithm. Exodus [57] translates existing device configurations to a simpler model, similar to our translation step. It translates router configurations to a high-level SDN controller program, which is implemented on top of OpenFlow. Exodus supports many Cisco IOS features. The translation problem solved by Exodus is comparable to this article’s problem of translating to a simple firewall model: OpenFlow 1.0 only supports a limited set of features (comparable to our simple firewall) whereas IOS supports a wide range of features (comparable to iptables). A complex language is ultimately translated to a simple language, which is the ‘hard’ direction. Since our approach loses the relation of the simplified rules to the original ruleset, our approach cannot point to individual flawed firewall rules, but only provides a complete overview. For example, our tool reduces thousands of firewall rules to the easy-to-understand graphinFig. 8, but the information which initial firewall rules and match conditions are responsible for each edge of the graph is lost. Complementary to our verification tool, and well-suited for debugging and uncovering responsible misbehaving rules, is Margrave [54]. Margrave can be used to query firewalls and to troubleshoot configurations or to show the impact of ruleset edits. Margrave can find scenarios, i.e., it can show concrete packets which violate a security policy. Our framework does not show such information. Margrave’s query language, which a potential user has to learn, is based on first-order logic. All these tools have one limitation in common: they do not understand all iptables match conditions. Our generic ruleset preprocessing algorithms help to make a ruleset accessible for the respective tool. However, our generic algorithms still lose too much information. This is because iptables conditions are also related to each other. For example, the iprange mod- ule allows to write down IP address ranges using a notation more expressive than most tools support. Just removing iprange matches would lose too much information, since tools understand matches on IP address ranges in a simpler format. We need to rewrite iprange expressions to a simpler, semantics-preserving notation of IP addresses, commonly under- stood by tools. This may be non-trivial since one rule with one iprange expression may correspond to several rules with only simple matches on IP addresses. As a more involved example, we saw that most firewall analysis tools do not support matching on interfaces. But given that a firewall implements spoofing protection and the routing tables are known, con- ditions matching on network interfaces can be rewritten to those matching on IP addresses. After an intermediate evaluation (Sect. 8), we present in Sect. 11 algorithms to overcome these issues for the most common match conditions. 4 Semantics of iptables We formalized the semantics of a subset of iptables. The semantics focuses on access control, which is done in the INPUT, OUTUT,and FORWARD chain of the filter table. Thus packet modification (e.g., NAT) is not considered (and also not allowed in these chains). Match conditions, e.g., source 192.168.0.0/24 and protocol TCP, are called primitives. A primitive matcher γ decides whether a packet matches a primitive. Formally, basedonaset X of primitives and a set of packets P, a primitive matcher γ is a binary relation over X and P. The semantics supports arbitrary packet models and match conditions, hence both remain abstract in our definition. In one firewall rule, several primitives can be specified. Their logical connective is con- junction, for example src 192.168.0.0/24 and tcp. Disjunction is omitted because 123 198 C. Diekmann et al. it is neither needed for the formalization nor supported by the iptables user interface; this is consistent with the model by Jeffrey and Samak [39]. Primitives can be combined in an algebra of match expressions M : mexpr = x for x ∈ X |¬ mexpr | mexpr ∧ mexpr | Any The match expression Any matches any packet. For a primitive matcher γ and a match expression m ∈ M ,wewrite match γ mp if a packet p ∈ P matches m, essentially lifting γ to a relation over M and P, with the connectives defined as usual. With completely generic P, X,and γ , the semantics can be considered to have access to an oracle which understands all possible match conditions. Furthermore, we support the following actions, modeled closely after iptables: Accept, Reject, Drop, Log, Empty, Call c for a chain c ,and Return.A rule can be defined as a tuple (m, a) for a match expression m and an action a. A list (or sequence) of rules is called a chain. For example, the beginning of the DOS_PROTECT chain in Fig. 1 is [(icmp ∧ icmptype 8 limit: ..., Return), ... ]. A set of named chains is called a ruleset.Let Γ denote the mapping from chain names to chains. For example, Γ DOS_PROTECT returns the contents of the DOS_PROTECT chain. We assume that Γ is well-formed, that is, if a Call c action occurs in a ruleset, then the chain named c is defined in Γ . This assumption is justified, because the Linux kernel only accepts well-formed rulesets. 4.1 Inductive Definition The semantics of a firewall wrt a given packet p, a background ruleset Γ ,and aprimitive matcher γ can be defined as a relation over the currently active chain and the state before and the state after processing this chain. The semantics is specified in Fig. 2. The judge- ment Γ, γ, p  rs, t ⇒ t states that starting with state t, after processing the chain rs, the resulting state is t . For a packet p, our semantics focuses on firewall filtering decisions. Therefore, only the following three states are necessary: the firewall may allow ( )ordeny ( ) the packet, or it may not have come to a decision yet ( ). We will now discuss the most important rules. Accept If the packet p matches the match expression m, then the firewall with no filtering decision ( ) processes the singleton chain [(m, Accept)] by switching to the allow state. Drop/Reject Both actions deny a packet. The difference lies in whether the firewall generates some informational message, which does not influence filtering. NoMatch If the firewall has not come to a filtering decision yet it can process any non-matching rule without changing its state. Decision As soon as the firewall made a filtering decision, all remaining rules can be skipped. Given determinism (Theorem 2), this means that once decided, the firewall does not change its filtering decision of or . Seq If the firewall has not come to a filtering decision and it processes the chain rs , which results in state t and starting from t processes the chain rs , 1 2 which results in state t , then both chains can be processed sequentially, ending in state t . CallResult If a matching Call to a chain named “c” occurs, the resulting state t is the result of processing the chain Γ c. Formalization: inductive iptables_bigstep [19]. 123 Verified iptables Firewall Analysis and Verification 199 match γm p Accept Skip Γ, γ, p  [],t ⇒ t Γ, γ, p  [(m, Accept)], ⇒ match γm p match γm p Drop   Reject ? ? Γ, γ, p  [(m, Drop)], ⇒ Γ, γ, p  [(m, Reject)], ⇒ ¬ match γm p t = NoMatch Decision ? ? Γ, γ, p  [(m, a)], ⇒ Γ, γ, p  rs,t ⇒ t Γ, γ, p  rs , ⇒tΓ,γ,p  rs ,t ⇒ t 1 2 Seq Γ, γ, p  rs ::: rs , ⇒ t 1 2 match γ m p Γ,γ,p  Γc, ⇒ t CallResult Γ, γ, p  [(m, Call c)], ⇒ t match γm pΓc = rs ::: (m , Return):: rs 1 2 ? ? match γm p Γ,γ,p  rs , ⇒ CallReturn ? ? Γ, γ, p  [(m, Call c)], ⇒ match γm p match γm p Log   Empty ? ? ? ? Γ, γ, p  [(m, Log)], ⇒ Γ, γ, p  [(m, Empty)], ⇒ (for any primitive matcher γ and any well-formed ruleset Γ ) Fig. 2 Big-step semantics for iptables CallReturn Likewise, if processing a prefix rs of the called chain does not lead to a filtering decision and directly afterwards, a matching Return rule occurs, the called chain is processed without result. Log/Empty Neither rule influences the filtering behavior. An Empty rule,i.e., arule without an action, is sometimes used by administrators to have iptables only update its internal state, e.g., updating packet counters. The semantics is carefully designed to not require a call stack. The format of the Call- Return rule is part of this design: if we tried to introduce a rule that allows to process a Return without either processing its matching Call or manipulating some call stack, we would necessarily cause problems with the Seq rule. This is because a separated rule for Return would need to remain in the state, and a later rule from the same chain (where we should already have returned from) could then switch to a decision state. One way of avoiding this problem is to merge the functionality of the Seq and Decision rules into all other rules. After doing so, one can introduce a separate Return rule and additionally remove the initial state, since it would always be . An example set of productions for such an alternate formu- lation is shown in Fig. 3. For the practical implementation of our proofs, this alternative lacks flexibility: since the Seq rule is no longer applicable, we cannot easily separate arguments about lists of rules from arguments about the different action types of rules. We provide this as an equivalent alternative because we hope that can provide additional confidence in the correctness of our semantics: Theorem 1 (Equivalence of the two Semantics) If no call to c occurs in any of the chains of Γ and default-policy is either Accept or Drop,then Formalization: theorem iptables_bigstep_r_eq. 123 200 C. Diekmann et al. match γm p match γm p Accept Return Γ, γ, p  (m, Accept):: rs ⇒ Γ, γ, p  (m, Return):: rs ⇒ match γm p match γm p Drop Reject Γ, γ, p  (m, Drop):: rs ⇒ Γ, γ, p  (m, Reject):: rs ⇒ ¬ match γm p Γ,γ,p  rs ⇒ t Skip NoMatch Γ, γ, p  (m, a):: rs ⇒ t Γ, γ, p  [] ⇒ match γm p Γ,γ,p  Γc ⇒tt ∈ , CallResult Γ, γ, p  (m, Call c):: rs ⇒ t Γ, γ, p  Γc ⇒ Γ, γ, p  rs ⇒ t CallNoResult Γ, γ, p  (m, Call c):: rs ⇒ t Γ, γ, p  rs ⇒ t Γ, γ, p  rs ⇒ t Log Empty Γ, γ, p  (m, Log):: rs ⇒ t Γ, γ, p  (m, Empty):: rs ⇒ t (for any primitive matcher γ and any well-formed ruleset Γ ) Fig. 3 Alternative big-step semantics for iptables Γ, γ, p [(m, Call c) ,(True, default-policy)]⇒ t ←→ Γ, γ, p  [(m, Call c) ,(True, default-policy)], ⇒ t Note that for finite rulesets (i.e., the image/range of Γ is finite), we can always find a c such that no call occurs to it. In practice, we will chose c to be INPUT, FORWARD,or OUTPUT. The Linux kernel rejects rulesets where a user calls these chains directly. 4.2 Model Limitations and Stateful Matchers Our primitive matcher is completely stateless: γ :: (X ⇒ P ⇒ B). However, iptables also allows stateful operations, such as marking a packet, and, later on, matching on the marking. The documentation of iptables distinguishes between match extensions and target exten- sions. Ideally, almost all match extensions can be used as if they were stateless. Anything which performs an action should be implemented as target extension, i.e., action. For exam- ple, marking a packet with CONNMARK is an action. Matching on a CONNMARK marking is a match condition. Our semantics does not support the CONNMARK action. This is not a problem since usually, new CONNMARK markings are not set in the filter table. However, it is possible to match on existing markings. Since our primitive matchers and packets are completely generic, this case can be represented within our semantics: instead of keeping an internal CONNMARK state, an additional “ghost field” must be introduced in the packet model. Since packets are immutable, this field cannot be set by a rule, but the packet must be given to the firewall with the final value of the ghost field already set. Hence, an analysis must be carried out with the correct value in the ghost fields when the packet is given to the filter table. We admit that this model is very unwieldy in general. However, for one of the most used stateful modules of iptables, namely connection state tracking with conntrack 123 Verified iptables Firewall Analysis and Verification 201 and state, this model has been proven to be very convenient. We will elaborate on stateful connection tracking (which can be fully supported by our semantics) in Sect. 11.2. For future work, if we want to consider e.g., the raw or mangle table with its extended set of actions or OpenFlow with its full set of actions, a semantics needs to be designed with a mutable packet model. What if a match extension maintains an internal state and changes its behavior on every invocation? Ideally, due to usability, iptables match extensions should be “purely functional”; however, the recent and connbytes modules exhibit side effects on their internal state. As a consequence, the tautology in Boolean logic “a ∧¬a = False” does not hold if a is a module which updates an internal state and its matching behavior after every invocation. Therefore, one might argue that our iptables model can only be applied to stateless match conditions. If we add some state σ and updated state σ to the match condition, the formula “a ∧¬a ” now correctly represents stateful match conditions. Therefore, it would only σ σ be wrong to perform equality operations on stateful match conditions, but not to model stateful match conditions with a specific fixed state. To additionally convince the reader of the soundness of our approach, it would be possible to adapt the parser to give a unique identifier to every primitive which is not known to be stateless. This identifier represents the internal state of that particular match condition at that particular position in a ruleset. It prevents equality operations between multiple invocations of a stateful match condition. This does not change any of our algorithms. 4.3 Analysis and Use of the Semantics The subsequent sections of this article are all based on these semantics. Whenever we provide a procedure P to operate on chains, we proved that the firewall’s filtering behavior is preserved, formally: Γ, γ, p  P rs, t ⇒ t iff Γ, γ, p  rs, t ⇒ t All our proofs are machine-verified with Isabelle. Therefore, once the reader is convinced of the semantics as specified in Fig. 2, the correctness of all subsequent theorems follows automatically, without any hidden assumptions or limitations. The rules in Fig. 2 are designed such that every rule can be inspected individually. However, considering all of them together, it is not immediately clear whether the result depends on the order of their application to a concrete ruleset and packet. Theorem 2 states that the semantics is deterministic, i.e., only one uniquely defined outcome is possible. Theorem 2 (Determinism) If Γ, γ, p  rs, t ⇒ t and Γ, γ, p  rs, t ⇒ t then t = t Next, we show that the semantics are actually total, i.e., there is always a decision for any packet and ruleset. We assume that the ruleset does not have an infinite loop and that all chains which are called exist in the background ruleset. These conditions are checked by the Linux kernel and can thus safely be assumed. In addition, we assume that only the actions defined in Fig. 2 occur in the ruleset; our parser rejects everything else. Formalization: file Semantics_Stateful.thy [19]. Formalization: theorem iptables_bigstep_deterministic [19]. Formalization: theorem semantics_bigstep_defined [19]. 123 202 C. Diekmann et al. We start any analysis with [(Any, Call start-chain), (Any, default-policy)],where the default policy is either Accept or Drop. This means that existing top-level Return actions fall back to the default policy. This is consistent with iptables behavior. Theorem 3 (Totality) If the caller–callee relation is well-founded (i. e., there are no infinite calling loops), Γ is well-formed (i. e., all chain names that are called are defined), there is no Return on top-level, and all actions are supported by the semantics, then ∃t .Γ,γ, p  rs, t ⇒ t To also assert empirically that we only allow analysis of iptables rulesets which are total according to our semantics, we always check the preconditions of Theorem 3 at runtime when our tool loads a ruleset: first, we can statically verify that Γ is well-formed by verifying that all chain names which are referenced in an action are defined and that no unsupported actions occur. Next, our tool verifies that there are no infinite loops by unfolding the ruleset (Sect. 5) only a finite but sufficiently large number of times and aborts if the ruleset is not in the proper form afterwards. These conditions have only been violated for a negligible fraction of all real-world firewalls we have analyzed. Those used very special iptables actions not supported by our semantics or special hand-crafted firewalls which deliberately violate a property and which are also rejected by the Linux kernel. 5 Custom Chain Unfolding In this section, we present algorithms to convert a ruleset from the complex chain model to the simple list model. The function pr (“process return”) iterates over a chain. If a Return rule is encountered, all subsequent rules are amended by adding the Return rule’s negated match expression as a conjunct. Intuitively, if a Return rule occurs in a chain, all following rules of this chain can only be reached if the Return rule does not match. add-match m rs =[(m ∧ m , a). (m, a) ← rs] pr [] = [] pr ((m, Return) :: rs) = add-match (¬m)(pr rs) pr ((m, a) :: rs) = (m, a) :: pr rs The function pc (“process call”) iterates over a chain, unfolding one level of Call rules. If a Call to the chain c occurs, the chain itself (i.e., Γ c) is inserted instead of the Call. However, Returns in the chain need to be processed and the match expression for the original Call needs to be added to the inserted chain. pc [] = [] pc ((m, Call c) :: rs) = add-match m (pr (Γ c)) ::: pc rs pc ((m, a) :: rs) = (m, a) :: pc rs For example, setting CONNMARK in the filter table where it was not necessary, redirecting packets to userspace with NFQUEUE where we do not know how the userspace application handles them, or specialized loggings such as NFLOG which is technically equivalent to the LOG action and could directly be supported. 123 Verified iptables Firewall Analysis and Verification 203 [(¬ (icmp ∧ icmptype 8 limit: ... ) ∧ icmp ∧ icmptype 8, Drop) , (¬ (icmp ∧ icmptype 8 limit: ... ) ∧¬ (tcp ∧ tcp flags:0x17/0x04 limit: ... ) ∧ tcp ∧ tcp flags:0x17/0x04, Drop),..., (src 192.168.0.0/16, Accept) , ... ] Fig. 4 Unfolded Synology firewall The procedure pc can be applied arbitrarily many times and preserves the semantics. Theorem 4 (pc sound and complete) Γ, γ, p  pc rs, t ⇒ t iff Γ, γ, p  rs, t ⇒ t In each iteration, the algorithm unfolds one level of Calls. The algorithm needs to be applied until the result no longer changes. Note that the syntax and semantics allow non- terminating rulesets. However, the only rulesets that are interesting for analysis are the ones actually accepted by the Linux kernel. Since it rejects rulesets with loops, both our algorithm and the resulting ruleset are guaranteed to terminate. Corollary 1 Every ruleset (with only Accept, Drop, Reject, Log, Empty, Call, Return actions) accepted by the Linux kernel can be unfolded completely while preserving its filtering behavior. Since we have not formally verified the Linux kernel sources, Corollary 1 is not formally proven. It follows from our previous theorems and we have extensively checked it empirically. In addition to unfolding calls, the following transformations applied to any ruleset preserve the semantics: – replacing Reject actions with Drop actions, –removing Empty and Log rules, – simplifying match expressions which contain Any or ¬ Any, – for some given primitive matcher, specific optimizations, e.g., rewriting src 0.0.0.0/0 to Any. Therefore, after unfolding and optimizing, a chain which only contains Accept or Drop actions is left. In the subsequent sections, we require this as a precondition. As an example, recall the firewall in Fig. 1.Its INPUT chain after unfolding and optimizing is listed in Fig. 4. Observe that some of the computed match expressions are beyond the expressiveness of what the iptables command line user interface supports. We will elaborate on this in Sect. 7. 6 Unknown Primitives As we argued earlier, it is infeasible to support all possible primitives of a firewall. Sup- pose a new firewall module is created which provides the ssh_blacklisted and Formalization: theorem unfolding_n_sound_complete [19]. The relevant check is in mark_source_chains,file source/net/ipv4/netfilter/ip_table s.c of the Linux kernel version 4.10. Formalization: theorem iptables_bigstep_rw_Reject [19]. Formalization: theorem iptables_bigstep_rm_LogEmpty [19]. Formalization: theorem unfold_optimize_ruleset_CHAIN [19]. Formalization: theorem unfold_optimize_common_matcher_univ_ruleset_CHAIN [19]. 123 204 C. Diekmann et al. ssh_innocent primitives. The former applies if an IP address has had too many invalid SSH login attempts in the past; the latter is the opposite of the former. Since we invented these primitives, no existing tool will support them. However, a new version of iptables could implement them or they may be provided as third-party kernel modules. Therefore, our rule- set transformations must take unknown primitives into account. To achieve this, we lift the primitive matcher γ to ternary logic, adding Unknown as matching outcome. We embed this new “approximate” semantics into the semantics described in the previous sections. Thus, it becomes easier to construct matchers tailored to the primitives supported by a particular tool. 6.1 Ternary Matching Logical conjunction and negation on ternary values are as in Boolean logic, with these additional rules for Unknown operands (commutative cases omitted): True ∧ Unknown = Unknown False ∧ Unknown = False ¬ Unknown = Unknown These rules correspond to Kleene’s 3-valued logic [42] and are well-suited for firewall semantics. For firewall rules, the first equation states that, if one condition matches, the final result only depends on the other condition. The next equation states that a rule cannot match if one of its conditions does not match. Finally, by negating an unknown value, no additional information can be inferred. The match expression Any always evaluates to True and ¬ Any always evaluates to False for any γ . A match expression may evaluate to Unknown if it contains unknown primitives x ∈ X. We demonstrate the ¬ Unknown = Unknown case by example: the two rulesets [(ssh_blacklisted, Drop)] and (Any, Call c) where Γ c =[(ssh_innocent, Return), (Any, Drop)] have exactly the same filtering behavior. After unfolding, the sec- ond ruleset collapses to [(¬ ssh_innocent, Drop)]. Both the ssh_blacklisted and the ssh_innocent primitives are Unknown to our matcher. Thus, since both rulesets have the same filtering behavior, a packet matching Unknown in the first ruleset should also match ¬ Unknown in the second ruleset. Stateful Matchers in Ternary Logic. In Sect. 4.2, we discussed the problem that some match conditions may maintain an internal state. For a match condition a which updates an internal state, “a ∧¬a = False” may not hold. We argued that for some state σ and σ , stateful match conditions need to be augmented with their internal state. For example “a ∧¬a ”, σ σ which is not a tautology. In our implementation, we immediately embed everything in ternary logic and treat all primitives which are not definitely stateless as “unknown”. This avoids the problem with internal state and yields “a ∧¬a = Unknown”, which correctly describes the behavior since we do not know about a potential internal state of some arbitrary match condition a. 6.2 Closures In the ternary semantics, it may be unknown whether a rule applies to a packet. Therefore, the matching semantics are extended with the notion of “in-doubt”-tactics. A tactic is consulted if the result of a match expression is Unknown. It decides whether a rule should apply or not. We introduce the in-doubt-allow and in-doubt-deny tactics. The first tactic forces a match if the rule’s action is Accept and a mismatch if it is Drop. The second tactic behaves in 123 Verified iptables Firewall Analysis and Verification 205 the opposite manner. Note that an unfolded ruleset is necessary, since no behavior can be specified for Call and Return actions. We denote the exact Boolean semantics with “⇒” and embedded ternary semantics with an arbitrary tactic α with “⇒ ”. In particular, α = allow for in-doubt-allow and α =deny analogously. “⇒”and “⇒ ” are related to the tactics as follows: considering the set of all accepted packets, in-doubt-allow is an overapproximation, whereas in-doubt-deny is an underapprox- imation. In other words, if “⇒” accepts a packet, then “⇒ ” also accepts the packet. allow Thus, from the opposite perspective, the in-doubt-allow tactic can be used to guarantee that a packet is certainly dropped. Likewise, if “⇒” denies a packet, then “⇒ ” also denies deny this packet. Thus, the in-doubt-deny tactic can be used to guarantee that a packet is certainly accepted. For example, the unfolded firewall of Fig. 1 contains rules which drop a packet if a limit is exceeded. If this rate limiting is not understood by γ,the in-doubt-allow tactic will never apply this rule, while with the in-doubt-deny tactic, it is applied universally. We say that the Boolean and the ternary matchers agree if they return the same result or the ternary matcher returns Unknown. Interpreting this definition, the ternary matcher may always return Unknown and the Boolean matcher serves as an oracle knowing the correct result. Note that we never explicitly specify anything about the Boolean matcher; therefore the model is universally valid, i.e., the proof holds for an arbitrary oracle. If the exact and ternary matcher agree, then the set of all packets allowed by the in-doubt- deny tactic is a subset of the packets allowed by the exact semantics, which in turn is a subset of the packets allowed by the in-doubt-allow tactic. Therefore, we call all packets accepted by ⇒ the lower closure, i.e., the semantics which accepts at most the packets that the deny exact semantics accepts. Likewise, we call all packets accepted by ⇒ the upper closure, allow i.e., the semantics which accepts at least the packets that the exact semantics accepts. Every packet which is not in the upper closure is guaranteed to be dropped by the firewall. Theorem 5 (Lower and upper closure of allowed packets) p.Γ, γ, p  rs, ⇒ deny p.Γ, γ, p  rs, ⇒ p.Γ, γ, p  rs, ⇒ allow The opposite holds for the set of denied packets. For the example in Fig. 1, we computed the closures (without the RELATED,ESTABLISH ED rule, see Sect. 6.4) and a ternary matcher which only understands IP addresses and layer 4 protocols. The lower closure is the empty set since rate limiting could apply to any packet. The upper closure is the set of packets originating from 192.168.0.0/16. The final decision for Call (resp. Return) rules depends on the called (resp. calling) chain. Formalization: theorem FinalAllowClosure [19]. Formalization: theorem FinalDenyClosure [19]. 123 206 C. Diekmann et al. 6.3 Removing Unknown Matches In this section, as a final optimization, we remove all unknown primitives. We call this algorithm pu (“process unknowns”). For this step, the specific ternary matcher and the choice of tactic must be known. In every rule, top-level unknown primitives can be rewritten to Any or ¬ Any. For example, let m be a primitive which is unknown to γ . Then, for in-doubt-allow, (m , Accept) is u u equal to (Any, Accept) and (m , Drop) is equal to (¬ Any, Drop). Similarly, negated unknown primitives and conjunctions of (negated) unknown primitives can be rewritten. Hence, the base cases of pu are straightforward. However, the case of a negated conjunction of match expressions requires some care. The following equation represents the De Morgan rule, specialized to the in-doubt-allow tactic. Any if pu (¬ m , a) = Any Any if pu (¬ m , a) = Any pu (¬ (m ∧ m ), a) = pu (¬ m , a) if pu (¬ m , a) =¬ Any 1 2 2 1 pu (¬ m , a) if pu (¬ m , a) =¬ Any ⎪ 1 2 ¬ (¬ pu (¬ m , a) ∧¬ pu (¬ m , a)) otherwise 1 2 The algorithm explicitly works on ‘Any’ instead of ‘True’, since in this context, Any is the syntactic base case of a match expression M and not a Boolean or ternary value. The ¬ Unknown = Unknown equation is responsible for the complicated nature of the De Morgan rule. Fortunately, we machine-verified all our algorithms. Anecdotally, we initially wrote a seemingly simple (but incorrect) version of pu and everybody agreed that the algorithm looks correct. In the early empirical evaluation, with yet unfinished proofs, we did not observe our bug. Only because of the failed correctness proof did we realize that we introduced an equation that only holds in Boolean logic. Theorem 6 (pu sound and complete) Γ, γ, p  [pu r. r ← rs], t ⇒ t if f Γ, γ, p  rs, t ⇒ t allow allow Theorem 7 Algorithm pu removes all unknown primitive match expressions. An algorithm for the in-doubt-deny tactic (with the same equation for the De Morgan case) can be specified in a similar way. Thus, ⇒ can be treated as if it were defined only on Boolean logic with only known match expressions. As an example, we examine the ruleset of the upper closure of Fig. 1 (without the RELATED, ESTABLISHED rule, see Sect. 6.4) for a ternary matcher which only under- stands IP addresses and layer 4 protocols. The ruleset is simplified to [(src 192.168.0.0/16, Accept), (Any, Drop)]. ITVal can now directly compute the correct results on this ruleset. 6.4 The RELATED, ESTABLISHED Rule Since firewalls process rules sequentially, the first rule has no dependency on any previous rules. Similarly, rules at the beginning have few dependencies on other rules. Therefore, Formalization: theorems transform_remove_unknowns_upper, transform_remove_unkno wns_lower [19]. 123 Verified iptables Firewall Analysis and Verification 207 firewall rules in the beginning can be inspected manually, whereas the complexity of manual inspection increases with every additional preceding rule. It is good practice to start a firewall with an ESTABLISHED (and sometimes RELATED) rule [29]. This also happens in Fig. 1 after the rate limiting. The ESTABLISHED rule usually matches most of the packets [29], which is important for performance; however, when analyzing the filtering behavior of a firewall, it is important to consider how a connection can be brought to this state. Therefore, we remove this rule and only focus on the connection setup. The ESTABLISHED rule essentially allows packet flows in the opposite direction of all subsequent rules [20]. Unless there are special security requirements (which is not the case in any of our analyzed scenarios), the ESTABLISHED rule can be excluded when analyzing the connection setup [20, Corollary 1]. If the ESTABLISHED rule is removed and in the subsequent rules, for example, a primitive state NEW occurs, our ternary matcher returns Unknown. The closure procedures handle these cases automatically, without the need for any additional knowledge. Our generic ruleset rewriting algorithms are not aware of connection state. Therefore, for our intermediate evaluation (Sect. 8), we removed ESTABLISHED rules by hand. In Sect. 11.2, we will describe our improvements which will enable support for conntrack state. There will no longer be any need to manually exclude rules. In short, we will fully support matches on conntrack state such as ESTABLISHED or NEW. The observation and argument of this section remains: for access control analysis, we focus on NEW packets. 7 Normalization Ruleset unfolding may result in non-atomic match expressions like ¬ (a ∧ b). The iptables user interface only supports match expressions in Negation Normal Form (NNF). There, a negation may only occur before a primitive, not before compound expressions. For example, ¬ ( src ip) ∧ tcp is a valid NNF formula, whereas ¬ (( src ip) ∧ tcp) is not. The reason is that iptables rules are usually specified on the command line and each primitive is an argument to the iptables command, for example ! –src ip -p tcp .Wenormalize match expressions to NNF, using the following observations: De Morgan’s rule can be applied to match expressions, splitting one rule into two. For example, (¬ ( src ip ∧ tcp ), Accept) and [(¬ src ip, Accept), (¬ tcp , Accept)] are equivalent. This introduces a “meta-logical” disjunction consist- ing of a sequence of consecutive rules with a shared action. For example, [(m , a), (m , a)] 1 2 is equivalent to [(m ∨ m , a)]. 1 2 For sequences of rules with the same action, a distributive law akin to common Boolean logic holds. For example, the conjunction of the two rulesets [(m , a), (m , a)] and [(m , a), (m , a)] 1 2 3 4 We revalidated this observation in September 2014 and found that in our firewall, which has seen more than 15 billion packets (>19TB data) since the last reboot, more than 95% of all packets matched the first RELATED,ESTABLISHED rule. The same can be concluded for reflexive ACLs in Cisco’s IOS Firewall [14]. Since match expressions do not contain disjunctions, any match expression in NNF is trivially also in Disjunctive Normal Form (DNF). 123 208 C. Diekmann et al. is equivalent to the ruleset [(m ∧ m , a), (m ∧ m , a), (m ∧ m , a), (m ∧ m , a)]. 1 3 1 4 2 3 2 4 This can be illustrated with a situation where a = Accept and a packet needs to pass two firewalls in a row. We can now construct a procedure which converts a rule with a complex match expression to a sequence of rules with match expressions in NNF. It is independent of the particular primitive matcher and the in-doubt tactic used. The algorithm n (“normalize”) of type M ⇒ M list is defined as follows: nAny =[Any] n (m ∧ m ) =[x ∧ y. x ← n m , y ← n m ] 1 2 1 2 n (¬ (m ∧ m )) = n (¬m ) ::: n (¬m ) 1 2 1 2 n (¬¬m) = n m n (¬ Any) =[] n x =[x ] for x ∈ X n (¬x ) =[¬x ] The second equation corresponds to the distributive law, the third to the De Morgan rule. For example, n (¬ ( src ip ∧ tcp )) = ¬ src ip, ¬ tcp . The fifth rule states that non-matching rules can be removed completely. The unfolded ruleset of Fig. 4, which consists of nine rules, can be normalized to a ruleset of 20 rules (due to distributivity). In the worst case, normalization can cause an exponential blowup. Our evaluation shows that this is not a problem in practice, even for large rulesets. This is because rulesets are usually managed manually, which naturally limits their complexity to a level processible by state-of-the-art hardware. Theorem 8 n always terminates, all match expressions in the returned list are in NNF, and their conjunction is equivalent to the original expression. We show soundness and completeness wrt arbitrary γ , α, and primitives. Hence, it also holds for the Boolean semantics. In general, proofs about the ternary semantics are stronger, because the ternary primitive matcher can simulate the Boolean matcher. Theorem 9 (n sound and complete) Γ, γ, p  [(m , a). m ← n m], t ⇒ t iff Γ, γ, p  [(m, a)], t ⇒ t α α After having been normalized by n, the rules can mostly be fed back to iptables. For some specific primitives, iptables imposes additional restrictions, e.g., that at most one primitive of a type may be present in a single rule. For our intermediate evaluation, we only need to solve this issue for IP address ranges in CIDR notation [31]. We introduced and verified another transformation which computes intersection of IP address ranges, which returns at most one range. This is sufficient to process all rulesets we encountered during our intermediate eval- uation. In the following sections, we show how to support more primitives; the intermediate evaluation only focuses on IP addresses; the final evaluation (Sect. 14) incorporates many more primitives. Formalization: theorem normalized_nnf_match_normalize_match [19]. Formalization: theorem normalize_match_correct [19]. Formalization: theorems β _approximating_bigstep_fun_iff_iptables_bigstep, magic LukassLemma [19]. 123 Verified iptables Firewall Analysis and Verification 209 8 Intermediate Evaluation In this section, we demonstrate the applicability of our ruleset preprocessing described thus far. Usually, network administrators are not inclined towards publishing their firewall ruleset because of potential negative security implications. For this intermediate evaluation, we have obtained approximately 20k real-world rules and the permission to publish them (Sect. 17). An even larger evaluation follows in Sect. 14. In addition to the running example in Fig. 1 (a small real-world firewall), we tested our algorithms on four other real-world firewalls. We put focus on the third ruleset, because it is one of the largest and the most interesting one. For our analysis, we wanted to know how the firewall partitions the IPv4 space. Therefore, we used a matcher γ which only understands source/destination IP addresses and the layer 4 protocols TCP and UDP. Our algorithms do not require special processing capabilities, they can be executed within seconds on a common off-the-shelf laptop with 4GB of memory. Ruleset 1 is taken from a Shorewall [28] firewall, running on a home router, with around 500 rules. We verified that our algorithms correctly unfolds, preprocesses, and simplifies this ruleset. We expected to see, in both the upper and lower closure, that the firewall drops packets from private IP ranges. However, we could not see this in the upper closure and verified that the firewall does indeed not block such packets if their connection is in a certain state. The administrator of the firewall confirmed this issue and, upon further investigation, rewrote the whole firewall. Ruleset 2 is taken from a small firewall script found online [38]. Although it only contains about 50 rules, we found that it contains a serious mistake. We assume the author accidentally confused iptables’ -I (insert at top) and -A (append at tail) options. We saw this after unfold- ing, as the firewall allows nearly all packets at the beginning. Subsequent rules are shadowed and cannot apply. However, these rules come with a documentation of their intended pur- pose, such as “drop reserved addresses”, which highlights the error. We verified the erroneous behavior by installing the firewall on our systems. Thus, our unfolding algorithm alone can provide valuable insights. Ruleset 3 and 4 are taken from the main firewall of our lab (Chair of Network Architectures and Services). One snapshot was taken 2013 with 2800 rules and one snapshot was taken 2014, containing around 4000 rules. It is obvious that these rulesets have grown historically. About 10 years ago, these two rulesets would have been the largest real-world rulesets ever analyzed in academia [82]. We present the analysis results of the 2013 version of the firewall. Details can be found in the additional material, the beginning of the ruleset is shown in Fig. 5.Weremovedthe first three rules. The first rule was the ESTABLISHED rule, as discussed in Sect. 6.4.Our focus was put on the second rule when we calculated the lower closure: this rule was responsible for the lower closure being the empty set. Upon closer inspection of this rule, we realized that it was ‘dead’, i.e., it can never apply. We confirmed this observation by changing the target to a Log action on the real firewall and could never see a hit of this rule for months. Due to our analysis, this rule could be removed. The third rule performed SSH rate limiting (a Drop rule). We removed this rule because we had a very good understanding of it. Keeping it would not influence correctness of the upper closure, but lead to a smaller lower closure than necessary. 123 210 C. Diekmann et al. -A FORWARD -m state --state RELATED,ESTABLISHED,UNTRACKED -j ACCEPT -A FORWARD -m recent --update --seconds 60 --name DEFAULT --rsource -j LOG_RECENT_DROP -A FORWARD -p tcp -m state --state NEW -m tcp --dport 22 --tcp-flags FIN,SYN,RST,ACK SYN ← -m recent --update --seconds 360 --hitcount 41 --name ratessh --rsource ← -j LOG_RECENT_DROP -A FORWARD -s 127.0.0.0/8 -j LOG_DROP -A FORWARD -s 131.159.14.206/32 -i vlan1011 -p tcp -m multiport --sports 389,636 -j ACCEPT -A FORWARD -s 131.159.14.208/32 -i vlan1011 -p tcp -m multiport --sports 389,636 -j ACCEPT ... -A LOG_DROP -m limit --limit 100/min -j LOG --log-prefix "[IPT_DROP]:" -A LOG_DROP -j DROP -A LOG_RECENT_DROP -m limit --limit 100/min -j LOG --log-prefix "[IPT_RECENT_DROP]:" -A LOG_RECENT_DROP -j DROP Fig. 5 Excerpt (first rules) of the 2013 iptables ruleset of our lab First, we tested the ruleset with the well-maintained Firewall Builder [59]. The original ruleset could not be imported by Firewall Builder due to 22 errors, caused by unknown match expressions. Using the calculated upper closure, Firewall Builder could import this ruleset without any problems. Next, we tested ITVal’s IP space partitioning query [49]. On our original ruleset with 2800 rules, ITVal completed the query with around 3GB of RAM in around 1min. Analyzing ITVal’s debug output, we found that most of the rules were not understood correctly due to unknown primitives. Thus, the results were not reliable. We could verify this as 127.0.0.0/8, obviously dropped by our firewall, was grouped into the same class as the rest of the Internet. In contrast, using the upper and lower closure ruleset, ITVal correctly identifies 127.0.0.0/8 as its own class. We found another interesting result about ITVal: the (optimized) upper closure ruleset only contains around 1000 rules and the lower closure only around 500 rules. Thus, we expected that ITVal could process these rulesets significantly faster. However, the opposite is the case: ITVal requires more than 10 times the resources (both CPU and RAM; we had to move the analysis to a big machine with > 40 GB of memory) to finish the analysis of the closures. We assume that this is due to the fact that ITVal now understands all rules. Yet, Sect. 14 will reveal that ITVal still computes wrong results. Limitations of the Translation. We inspected the simplified rulesets and observed a few limitations of the translation. Those limitations mainly occur because our algorithms work on arbitrary γ . While this an important feature, it also means that we did not consider the peculiarities of specific primitives so far. We said that iptables only accepts match expressions in NNF, but this condition alone is insufficient. In addition to NNF, each primitive must occur at most once in a match expression. For example, iptables does not allow to have two -s primitives which match on source IP addresses in an expression. However, such expressions may occur after unfolding and NNF normalization. For this intermediate evaluation, we solved this problem since we can compress the conjunction of an arbitrary number of matches on IP addresses to a single match on IP addresses: the intersection of IP address ranges in CIDR notation is either the smallest of all ranges, or the empty set (details follow in Sect. 11.1). Similarly, the conjunction of all the same matches on protocols is either the protocol itself, otherwise the match expression cannot apply to any packet and the complete rule can be removed. For example, a rule which matches on both tcp and icmp can be removed as a packet cannot be both. In addition, we see rules with ‘unknown’-parts (before the removal of unknown primitives) which can never match and should be removed. For example, it is impossible for a packet the have only the SYN and only the ACK flags set at the same time. However, without providing knowledge about tcp flags, our generic treatment of unknown match conditions may assume that this match 123 Verified iptables Firewall Analysis and Verification 211 condition may apply and such rules remain after the simplification. Hence, our simplification is still too coarse grained and loses too much information. In addition, as we indicated in Sect. 3.2, primitives may also be related and can be transformed into simpler primitives. We elaborate on the treatment of primitives in the following sections. 9 Simple Firewall Model Now, we present a very simple firewall model. This model was designed to feature nice mathematical properties, but it is too simplistic to mirror the real world. Afterwards, we will compare it to our model for real-world firewalls of Sect. 4. Section 10 will show how rulesets can be translated between these two models. This preprocessing step converts firewall rulesets from the real-world model to the simple model, which greatly simplifies all future static firewall analysis. We will write simple firewall rules as tuple (m, a),where m is a match expression and a is the action the firewall performs if m matches for a packet. The firewall has two possibilities for the filtering decision: it may accept ( ) the packet or deny ( ) the packet. We will also use the intermediate state ( ) in which the firewall did not come to a filtering decision yet. Note that iptables firewalls always have a default policy and the case cannot occur as final decision for the simple firewalls we will construct. The semantics of the simple model is given by a recursive function. The first parameter is the ruleset the firewall iterates over, the second parameter is the packet. simple-fw [] p = simple-fw ((m, Accept) :: rs) p = if smatch mp then else simple-fw rs p simple-fw ((m, Drop) :: rs) p = if smatch mp then else simple-fw rs p A function smatch tests whether a packet p matches the match condition m. The match condition is an 7-tuple, consisting of the following primitives: (in, out, src, dst, protocol, src ports, dst ports) In contrast to iptables, negating matches is not supported. In detail, the following primitives are supported: – In/out interface, including support for the ‘+’ wildcard – Source/destination IP address range in CIDR notation, e.g., 192.168.0.0/24 –Protocol (any, tcp, udp, icmp, or any numeric protocol identifier) – Source/destination interval of ports, e.g., 0:65535 For example, we obtain an empty match (a match that does not apply to any packet) if and only if an end port is greater than the start port. The match which matches any packet is constructed by setting the interfaces to ‘+’, the IP to 0.0.0.0/0, the ports to 0:65535 and the protocol to any. We require that all match conditions are well-formed, i.e., it is only allowed to match on ports (other than the universe 0:65535) if the protocol is tcp, udp, or sctp. Note that this is not the same function as in Sect. 4, because this simple smatch function does not require parameter γ . Roughly speaking, it already has the primitive matcher hard-coded into it. Formalization: theorem empty_match [22]. Formalization: theorem simple_match_any [22]. 123 212 C. Diekmann et al. With this type of match expression, it is possible to implement a function conj which takes two match expressions m and m and returns exactly one match expression being the 1 2 conjunction of both. Theorem 10 (Conjunction of two simple match expressions) smatch m p ∧ smatch m p ←→ smatch (conj m m ) p 1 2 1 2 Computing the conjunction of the individual match expressions for port intervals and single protocols is straightforward. The conjunction of two intervals in CIDR notation is either empty or the smaller of both intervals. The conjunction of two interfaces is either empty if they do not share a common prefix, otherwise it is the longest of both interfaces (non-wildcard interfaces dominate wildcard interfaces). The conj of two well-formed matches is again well-formed. The type of match expressions was carefully designed such that the conjunction of two match expressions is only one match expression. If features were added to the match expres- sion, for example negated interfaces, this property would no longer be guaranteed. Of the features most commonly found in our iptables firewall rulesets [3], we only found that it would further be possible to add TCP flags to the match expression without violating the aforementioned conjunction property. Considering common features of firewalls in general [70], it would probably be possible to enhance the ICMP support of our model. One advantage of simple-fw over the semantics of Fig. 2 is that it is a simple recursive function. In addition, simple-fw is total, i.e., it is guaranteed to terminate. This is not the case for the semantics of Fig. 2, as the assumptions of Theorem 3 show. Hence, the simple firewall makes proofs about the filtering behavior much easier as they can often be done by a list induction over the ruleset. Another advantage is that the smatch function of simple-fw is completely defined and it is no longer required to reason about an arbitrary but fixed function γ . 10 Translation to the Simple Firewall Model The semantics given in Sect. 4 includes a primitive matcher γ that decides whether a certain primitive matches a packet. The model and all algorithms on top of it are proven correct for an arbitrary γ , hence, this model supports all iptables matching features. Obviously, there is no executable code for an arbitrary γ . However, the algorithms to transform rulesets we present are executable. To have a clear semantics of the primitives, we have defined a subset of γ , namely for all primitives supported by the simple firewall and some further primitives, detailed in Sect. 11. We assume that γ behaves as expected on our subset, but it may show arbitrary behavior for all other primitives. We say we agree on γ . For example, γ behaves as expected on IP addresses, but it may show arbitrary behavior for a bfp match. Using our previously described algorithms, we assume that the ruleset is already unfolded and the match expressions are normalized. This leaves a ruleset where only the following actions occur: Accept and Drop. Thus, a large step for translating the real-world model to the simple firewall model is already accomplished. Translating the match expressions for the simple firewall remains. Of course, it is not possible to translate all primitives to the very Formalization: theorem simple_match_and_correct [22]. Formalization: theorem simple_match_and_valid [22]. Formalization: theorems rewrite_Goto_chain_safe, unfold_optimize_common_matcher _univ_ruleset_CHAIN [19]. 123 Verified iptables Firewall Analysis and Verification 213 limited simple-fw model, so we will make use of the pu algorithm when necessary. For the sake of example, we will only consider the overapproximation in the following parts of this article; the underapproximation is analogous and can be found in our formalization. Since firewalls usually accept all packets which belong to an ESTABLISHED connection, the interesting access control rules in a ruleset only apply to NEW packets. We only consider NEW packets, i.e., −−ctstate NEW and −−syn for TCP packets. Our first goal is to translate a ruleset from the real-world model to the simple model. We have proven that the set of new packets accepted by the simple firewall is a superset (overapproximation) of the packets accepted by the real-world model. This is a core contribution and we expand on the translation in the following section. Theorem 11 (Translation to simple firewall model) For γ we agree on p. new p ∧ Γ, γ, p  rs, ⇒ p. new p ∧ simple-fw (translate-oapprox rs) p = Any packet dropped by the translated, overapproximated simple firewall ruleset is guar- anteed to be dropped by the real-world firewall, for arbitrary γ , Γ , rs. Similar guarantees for definitely accepted packets can be given by considering the translated underapproximation. Given the simplicity of the simple-fw model, it is much easier to write algorithms to analyze and verify the translated rulesets. Example. Because this article proceeds to focus more on individual primitives, we will increasingly use the more precise syntax of iptables-save which is also described by the man pages iptables(8) and iptables-extensions(8). We consider a FORWARD chain with a default policy of Drop and a user-defined chain foo. -P FORWARD DROP -A FORWARD -s 10.0.0.0/8 -j foo -A foo ! -s 10.0.0.0/9 -j DROP -A foo -p tcp -j ACCEPT This ruleset, although it only consists of three rules and a default policy, is complicated to analyze. Our translation algorithm translates it to the simple firewall model, where the ruleset becomes remarkably simple. We use ∗ to denote a wildcard: ( ∗ , ∗ , 10.128.0.0/9, ∗ , ∗ , ∗ , ∗ ) Drop ( ∗ , ∗ , 10.0.0.0/8 , ∗ ,tcp, ∗ , ∗ ) Accept ( ∗ , ∗ , ∗ , ∗ , ∗ , ∗ , ∗ ) Drop No over- or underapproximation occurred since all primitives could be translated. Note the 10.128.0.0/9 address range, which is the result of the intersection of 10.0.0.0/8 and the negation of 10.0.0.0/9. Formalization: theorems new_packets_to_simple_firewall_overapproximation, new_packets_to_simple_firewall_underapproximation [19]. 123 214 C. Diekmann et al. 11 Translating Primitives In this section, we present algorithms to transform specific primitives without changing the behavior of the firewall. As a result, the primitive matches on interfaces, IP addresses, protocols, and ports will be normalized such that the translation to the simple-fw is obvious. Since iptables supports over 200 individual options for match conditions, we cannot cover all. For example, we do not support any IPsec ah or esp matches or bpf matches, but we will simply abstract over them using our algorithm pu. However, we support the most common features found in common iptables rulesets. Simple matches, such as -s or -d to match on source or destination IP addresses are already supported by the simple-fw.The iprange or multiport module allow matching on IP addresses and ports, but are more expressible than the simple-fw supports. We translate them without the loss of information, but at the cost of increased ruleset size. Other modules, such as conntrack state or tcp flags cannot be expressed in the simple-fw at all. However, we are sometimes able to rewrite them directly to Any or ¬ Any. We continue by describing the normalization of all common primitives found in iptables rulesets. 11.1 IPv4 Addresses According to Nelson [54], “[m]odeling IP addresses efficiently is challenging.” First, we present a datatype to efficiently perform set operations on intervals of machine words, e.g., 32bit integers. We will use this type for IPv4 addresses, but we have generalized to machine words of arbitrary length, e.g., IPv6 addresses or layer 4 ports. For brevity, we will present our formalization at the example of IPv4. We call our datatype a word interval (wi), and WI start end describes the (inclusive) interval. The Union of two wisisdefined recursively. datatype wi = WI word word | Union wi wi Let set denote the interpretation into mathematical sets, then wi has the following semantics: set (WI start end) ={x | start ≤ x ≤ end} set (Union wi wi ) = set wi ∪ set wi 1 2 1 2 An IP address in CIDR notation or IP addresses specified by e.g., −m iprange can be translated to a single WI value. We have implemented and proven correct the common set operations: ‘∪’, ‘{}’, ‘\’, ‘∩’, ‘⊆’, and ‘=’. These operations are linear in the number of Union constructors. The result is optimized by merging adjacent and overlapping intervals and removing empty intervals. We can also represent ‘UNIV’ (the universe of all IP addresses). Since most rulesets use IP addresses in CIDR notation or intervals in general, the wi datatype has proven to be very efficient. Recall that the intersection of two intervals, constructed from addresses in CIDR notation, is either empty or the smaller of both intervals. The datatype wi is an internal representation and for the simple firewall, the result needs to be represented in CIDR notation. For this direction, one WI may correspond to several CIDR ranges. We describe an algorithm to split off one CIDR range from an arbitrary word interval r. The output is a CIDR range and r , the remainder after splitting off this CIDR All lemmas and results of the following subsections ultimately yield Theorem 11 and are referenced in its proof. Formalization: theorem ipcidr_conjunct_correct [24]. 123 Verified iptables Firewall Analysis and Verification 215 range. split is implemented as follows: let a be the lowest element in r. If this does not exist, then r corresponds to the empty set and the algorithm terminates. Otherwise, we construct the listofCIDRranges [a/0, a/1, ..., a/32]. The first element in the list which is well-formed (i.e., all bits after the network prefix must be zero) and which is a subset of r is the wanted element. Note that this element always exists. It is subtracted from r to obtain r .Toconvert r completely to a list of CIDR ranges, this is applied recursively until it yields no more results. This algorithm is guaranteed to terminate and the resulting list in CIDR notation corresponds to the same set of IP addresses as represented by r. Formally, map set (split r ) = set r. Example. split (WI 10.0.0.0 10.0.0.15) =[10.0.0.0/28] split (WI 10.0.0.1 10.0.0.15) =[10.0.0.1/32, 10.0.0.2/31, 10.0.0.4/30, 10.0.0.8/29] With the help of these functions, arbitrary IP address ranges can be translated to the format required by the simple firewall. The following is applied to matches on source and destination IP addresses: first, the IP match expression is translated to a word interval. If the match on an IP range is negated, we compute UNIV \ wi. All matches in one rule can be joined to a single word interval, using the ∩ operation. The resulting word interval is translated to a set of non-negated CIDR ranges. Using the NNF normalization, at most one match on an IP range in CIDR notation remains. We have proven that this process preserves the firewall’s filtering behavior. We conclude with a simple, artificial worst-case example. The evaluation shows that it does not prevent successful analysis: −m iprange−−src-range 0.0.0.1-255.255. 255.254. Translated to the simple firewall, this one range blows up to 62 ranges in CIDR notation. A similar blowup may occur for negated IP ranges. Note that, while pretty printing IPv4 addresses in dotecimal notation (i.e., <dotnum> ::= <snum> . <snum> . <snum> . <snum> [75]) is simple, pretty print- ing IPv6 addresses is non-trivial [40] and our implementation contains the first formally machine-verified IPv6 pretty printer [24]. 11.2 conntrack State If a packet p is matched against the stateful match condition ESTABLISHED, conntrack looks up p in its state table. When the firewall comes to a filtering decision for p,ifthe packet is not dropped and the state was NEW, the conntrack state table is updated such that the flow of p is now ESTALISHED. Similarly, other conntrack states are handled. We present an alternative model for this behavior: before the firewall starts processing the ruleset for p, the conntrack state table is consulted for the state of the connection of p. This state is added as a (phantom) tag to p. Therefore, ctstate can be modeled as just another header field of p. When processing the ruleset, it is not necessary to inspect the conntrack table but only the virtual state tag of the packet. After processing, the state table is updated accordingly. We have proven that both models are equivalent to each other. The latter model is simpler for analysis purposes since the conntrack state can be considered an ordinary packet field. Formalization: theorem cidr_split_prefix [24]. Formalization: file Semantics_Stateful.thy [19]. This holds because the semantics does not modify a packet during filtering. 123 216 C. Diekmann et al. In Theorem 11, we are only interested in NEW packets. In contrast to our intermediate evaluation (Sect. 8), there is no longer the need to manually exclude ESTABLISHED rules from a ruleset. The alternative model allows us to consider only NEW packets: all state matches can be removed (by being pre-evaluated for an arbitrary NEW packet) from the ruleset without changing the filtering behavior of the firewall. 11.3 Layer 4 Ports Translating singleton ports or intervals of ports to the simple firewall is straightforward. A challenge remains for negated port ranges and the multiport module. However, the word interval type is also applicable to 16bit machine words and solves these challenges. For ports, there is no need to translate an interval back to CIDR notation. In the original paper [23], we made a serious mistake [27] when specifying the semantics of matches on ports. Fortunately, the error only manifests itself in corner cases and did not affect the published evaluation. However, we have seen rulesets in the wild which triggered the bug, hence, it is not purely of academic nature. Since we have proven the correctness of all our algorithms and checked all assumptions, the bug did not exist in the code, but in the model. We describe the problem and its resolution (which has already been implemented) in this section. We defined the datatype of a source port match as follows: datatype src-ports = SrcPorts (16 word × 16 word) This datatype describes a source port match as an interval of 16 bit port numbers. The match semantics for a packet were defined such that the source port of the packet must be in the interval. For example, packet p matches SrcPorts ab if and only if a ≤ p.src-port ≤ b.We defined DstPorts analogously. With these semantics, we can construct a corner case which describes why this model does not correspond to reality. Consider the following firewall: *filter :FORWARD ACCEPT [0:0] :CHAIN - [0:0] -A FORWARD -j CHAIN -A CHAIN -p tcp -m tcp --sport 22 -j RETURN -A CHAIN -p udp -m udp --dport 80 -j RETURN -A CHAIN -j DROP COMMIT The firewall in iptables-save format shows the filter table, which consists of the two chains FORWARD and CHAIN.The FORWARD chain is built-in and has a default policy of Accept here. Starting at the FORWARD chain, any packet which is processed by this firewall is directly sent to the user-defined chain CHAIN first. A packet can only Return if it is a TCP packet with source port 22 or a UDP packet with destination port 80. All other packets are dropped. Hence, this firewall expresses in a complicated way the following policy: “Drop everything which is not tcp source port 22 or udp destination port 80”. This ruleset, though it does not have an obvious use, was artificially constructed to demonstrate our bug. Our tool has “simplified” the ruleset in the following way: As a side note, OpenFlow (technically, the Open vSwitch) defines CIDR-like matching for layer 4 ports. With the small change of converting ports to CIDR-like notation, our simple firewall can be directly converted to OpenFlow and we have the first (almost) fully verified translation of iptables rulesets to SDN [50]. 123 Verified iptables Firewall Analysis and Verification 217 ( ∗ , ∗ , ∗ , ∗ , ∗ , 0 : 21 , 0 : 79 ) Drop ( ∗ , ∗ , ∗ , ∗ , ∗ , 0 : 21 , 81 : 65535) Drop ( ∗ , ∗ , ∗ , ∗ , ∗ , 23 : 65535 , 0 : 79 ) Drop ( ∗ , ∗ , ∗ , ∗ , ∗ , 23 : 65535 , 81 : 65535) Drop ( ∗ , ∗ , ∗ , ∗ , ∗ , ∗ , ∗ ) Accept Given our semantics, the simplification is correct. In reality, this simple firewall is wrong for various reasons. First, it is not well-formed, i.e., it tries to match on ports without specifying a protocol. Second, it has mixed up UDP and TCP ports. The problem lies in our semantics of SrcPorts and DstPorts. Roughly speaking, there is no such a thing as “ports”, but TCP ports, UDP ports, SCTP ports, and many others. We have resolved the issue by including the protocol in the match for a port: datatype src-ports = SrcPorts (8 word)(16 word × 16 word) The 8 word corresponds to the protocol field in IPv4 [68], respectively the Next Header field in IPv6 [17], identifying protocols by their assigned numbers [72,73]. It does not allow a wildcard. The semantics defines that the protocol of a packet must be the same as specified in the datatype and that the source port must be in the interval (as in the first definition). With the corrected semantics, our tool computes the correct and expected result: ( ∗ , ∗ , ∗ , ∗ , udp , ∗ , 0 : 79 ) Drop ( ∗ , ∗ , ∗ , ∗ , udp , ∗ , 81 : 65535) Drop ( ∗ , ∗ , ∗ , ∗ , tcp , 0 : 21 , ∗ ) Drop ( ∗ , ∗ , ∗ , ∗ , tcp , 23 : 65535 , ∗ ) Drop ( ∗ , ∗ , ∗ , ∗ , ∗ , ∗ , ∗ ) Accept The negation of a match on ports is the interesting corner case to which the presented problems can be reduced to. We will illustrate the issue with a simpler example. Assuming we have one rule which tries to accept every packet which is not udp destination port 80. For simplicity, we assume we have one rule as follows: ! (-p udp --dport 80) -j ACCEPT . Semantically, to unfold this negation, the rule matches either everything which is not udp or everything which is udp but not destination port 80. It can be expressed with the following two rules: ! -p udp -j ACCEPT followed by -p udp ! --dport 80 -j ACCEPT . We use this strategy in our tool to unfold the negation of matches on ports. Note the type dependencies which occur: negating one rule that matches on ports yields both a rule which matches on protocols and one rule which matches on ports. This example also shows that any tool which reduces match conditions to a flat bit vector is either flawed (it loses the protocol which belongs to a match on ports) or cannot support complicated negations. This includes tools which reduce firewall analysis to SAT [39]or BDDs [1,85]. It may probably also affect ITVal [48] which relies on multi-way decision diagrams (MDD). This was also the case for our Γ, γ, p  rs, s ⇒ t semantics with the Note that this cannot be expressed directly in one rule with iptables. In the example, we used the semantics of Return to construct a compound negated match expression. 123 218 C. Diekmann et al. flawed γ described here. Our simple firewall model does not allow complicated negations and we have proven that the match conditions are always well-formed, hence, the presented class of errors cannot occur there. 11.4 TCP Flags iptables can match on a set of layer 4 flags. To match on flags, a mask selects the corresponding flags and c declares the flags which must be present. For example, the match --syn is a synonym for mask = SYN, RST, ACK, FIN and c = SYN.For aset f of flags in a packet, matching can be formalized as f ∩ mask = c.If c is not a subset of mask, the expression cannot match; we call this the empty match. We proved that two matches (mask , c ) and 1 1 (mask , c ) are equal if and only if (if c ⊆ mask ∧ c ⊆ mask then c = c ∧ mask = 2 2 1 1 2 2 1 2 1 mask else (¬c ⊆ mask ) ∧ (¬c ⊆ mask )) holds. We also proved that the conjunction 2 1 1 2 2 of two matches is exactly (if c ⊆ mask ∧ c ⊆ mask ∧ mask ∩ mask ∩ c = mask ∩ 1 1 2 2 1 2 1 1 mask ∩c then (mask ∪mask , c ∪c ) else empty). If we assume --syn for a packet, we 2 2 1 2 1 2 can remove all matches which are equal to --syn and add the --syn match as conjunction to all other matches on flags and remove rules with empty matches. Some matches on flags may remain, e.g., URG, which need to be abstracted over later. 11.5 Interfaces The simple firewall model does not support negated interfaces, e.g., ! -i eth+. Therefore, they must be removed. We first motivate the need for abstracting over negated interfaces. For whitelisting scenarios one might argue that the use of negated interfaces constitutes bad practice. This is because new (virtual) interfaces might be added to the system at runtime and a match on negated interfaces might now also include these new interfaces. Therefore, negated interfaces correspond to blacklisting, which is not recommended for most firewalls. However, the main reason why negated interfaces are not supported by our model is of technical nature: let set denote the set of interfaces that match an interface expression. For example, set eth0 ={eth0} and set eth+ is the set of all interfaces that start with the prefix eth.Ifthe matchon eth+ is negated, then it matches all strings in the complement set: UNIV \ (set eth+). The simple firewall model requires that a conjunction of two primitives is again at most one primitive. This can obviously not be achieved with such sets. In addition, working with negated interfaces can cause great confusion. Note that the interface match condition ‘+’ matches any interfaces. Also note that ‘+’ ∈ UNIV \ (set eth+). Here, ‘+’is not a wildcard character but the name of an interface. The confusion introduced by negated interfaces becomes more apparent when one realizes that ‘+’ can occur as both wildcard character and normal character. Therefore, it is not possible to construct an interface match condition which matches exactly on the interface ‘+’, because a ‘+’ at the end of an interface match condition is interpreted as wildcard. While technically, the Linux kernel would allow to match on ‘+’ as a normal character [46], the iptables command does not permit to construct such a match [60]. 11.6 Interaction of Interfaces with IP Ranges Later, in Sect. 12.1, we will compute an IP address space partition. For better understanding, that partition should not be “polluted” with interface information. Therefore, for the partition, we will assume that no matches on interfaces occur in the ruleset. In this section, we describe We strongly discourage the use of “ip link set eth0 name +”[18]. 123 Verified iptables Firewall Analysis and Verification 219 a method to remove both negated and non-negated interfaces while preserving their relation to IP address ranges. Input interfaces are usually assigned an IP range of valid source IPs which are expected to arrive on that interface. Let ipassmt be a mapping from interfaces to an IP address range. This information can be obtained by ip route and ip addr. We will write ipassmt[i ] for the corresponding IP range of interface i. For the following examples, we assume ipassmt =[eth0 →{10.8.0.0/16}] The goal is to rewrite input interfaces with the corresponding source IP range. For example, we would like to replace all occurrences of -i eth0 with -s 10.8.0.0/16. This idea can only be sound if there are no spoofed packets; we only expect packets with a source IP of 10.8.0.0/16 to arrive at eth0. Once we have assured that the firewall blocks spoofed packets, we can assume in a second step that there are no spoofed accepted packets left. By default, the Linux kernel offers reverse path filtering, which blocks spoofed packets automat- ically. In this case we can assume that no spoofed packets occur. In some complex scenarios, reverse path filtering needs to be disabled and spoofed packets should be blocked manually with the help of the firewall ruleset. In previous work [26], we presented an algorithm to verify that a ruleset correctly blocks spoofed packets. This algorithm is integrated in our frame- work, proven sound, works on the same ipassmt, and does not need the simple firewall model (i.e., supports negated interfaces). If some interface i should accept arbitrary IP addresses (essentially not providing spoofing protection), it is possible to set ipassmt[i]= UNIV. Therefore, we can verify spoofing protection according to ipassmt at runtime and afterwards continue with the assumption that no spoofed packets occur. Under the assumption that no spoofed packets occur, we will now present two algorithms to relate an input interface i to ipassmt[i ]. Both approaches are valid for negated and non-negated interfaces. The first approach provides better results but requires stronger assumptions (which can be checked at runtime), whereas the second approach can be applied without further assumptions. First Approach. In general, it is considered bad practice [82,83] to have zone-spanning interfaces. Two interfaces are zone-spanning if they share a common, overlapping IP address range. Mathematically, absence of zone-spanning interfaces means that for any two interfaces in ipassmt, their assigned IP range must be disjoint. Our tool emits a warning if ipassmt contains zone-spanning interfaces. If no zone-spanning interfaces are detected, then all input interfaces can be replaced by their assigned source IP address range. This preserves exactly the behavior of the firewall. In this case, there is an injective mapping between input interfaces and source IPs. Interestingly, our proof does not need the assumption that ipassmt maps to the complete IP universe. Second Approach. Unfortunately, though considered bad practice, we found zone-spanning interfaces in many real-world configurations and hence cannot apply the previous algorithm. First, we proved that correctness of the described rewriting algorithm implies absence of zone-spanning interfaces. This leads to the conclusion that it is impossible to perform rewriting without this assumption. Therefore, we present an algorithm which adds the IP range information to the ruleset (without removing the interface match), thus constraining the match on input interfaces to their IP range. The algorithm computes the following: whenever there is a match on an input interface i, the algorithm looks up the corresponding IP range Formalization: theorem iface_replace_needs_ipassmt_disjoint [19]. 123 220 C. Diekmann et al. of that interface and adds -s ipassmt[i ] to the rule. To prove correctness of this algorithm, no assumption about zone-spanning interfaces is needed, ipassmt may only be defined for a subset of the interfaces, and the range of ipassmt may not cover the complete IP universe. Consequently, there is no need for a user to specify ipassmt, but having it may yield more accurate results. Output Port Rewriting. Our presented approaches for input interface rewriting can be gener- alized to also support output interface (-o) rewriting. The core idea is to replace a match on an output interface by the corresponding IP address range which is determined by the system’s routing table. To do this, we parse the routing table, map it to a relation (which provides a structure which is independent of its order), and compute the inverse of the relation. This ultimately provides a mapping for each interface and its corresponding IP address range. This computed mapping is very similar to the ipassmt. In fact, we found it to be a helpful debugging tool to compare the inverse routing relation to an ipassmt. For convenience, we also provide a function to compute an ipassmt from a routing table. Essentially, computing the inverse routing relation semantically is the same behavior as found in strict reverse path filtering [5]. We have formally proven this observation. Because a routing table may change frequently, even triggered by external malicious routing advertisements, by default, we refrain from output port rewriting in this work. In general, we will not apply it in our evaluation (Sect. 14,Table 1); however, in one case (Sect. 14, Firewall D) we will additionally show how the results improve. 11.7 Abstracting Over Primitives Some primitives cannot be translated to the simple model. Section 6.3 already provides the function pu which removes all unknown match conditions. This leads to an approximation and is the main reason for the ‘⊆’ relation in Theorem 11. We found that we can also rewrite any known primitive at any time to an unknown primitive. This can be used to apply additional knowledge during preprocessing. For example, since we understand flags, we know that the following condition is false, hence rules using it can be removed: --syn ∧ --tcp-flags RST,ACK RST. After this optimization, all remaining flags can be treated as unknowns and abstracted over afterwards. This allows to easily add additional knowledge and optimization strategies for further primitive match conditions without the need to adapt any algorithm which works on the simple firewall model. We proved soundness of this approach: the ‘⊆’ relation in Theorem 11 is preserved. 12 Analyzing Simple Firewall Rulesets In this section, we will show two algorithms that work on rulesets translated to the simple-fw model. 12.1 IP Address Space Partitioning We present an algorithm to partition the full space of IP addresses into equivalence classes. It runs roughly in linear time in the number of rules for real-world rulesets. All IP addresses in the same partition show the same behavior wrt the firewall ruleset. We do Formalization: theorem rpf_strict_correct [51]. 123 Verified iptables Firewall Analysis and Verification 221 Table 1 Summary of evaluation on real-world firewalls Fw Rules Chain (unfolded) Simple rules (no ifaces) Use Parts (ITVal) SS H H T T P Time (ITVal) Time (this) [s] A 2784 FW (2376) 2381 (1920) ✓ 246 (1) 13 9 3 h 172 r a – FW (2376) 2837 (581) ✗ 522 (1) 1 1 9 h 194 A 4113 FW (2922) 3114 (2862) ✓ 334 (2) 11 11 27 h 302 – FW (2922) 3585 (517) ✗ 490 (1) 1 1 8 h 320 A 4814 FW (4403) 3574 (3144) ✓ 364 (2) 9 12 46 h 477 r a – FW (4403) 5123 (1601) ✗ 1574 (1) 1 1 3 h 618 A 4946 FW (4887) 4004 (3570) ✓ 371 (2) 9 12 53 h 578 r a – FW (4887) 5563 (1613) ✗ 1585 (1) 1 1 4 h 820 B 88 FW (40) 110 (106) ✓ 50 (4) 4 2 2 s 3 – FW (40) 183 (75) ✓ 40 (1) 1 1 1 s 2 C 53 FW (30) 29 (12) ✓ 8(1) 1 1 1s 1 – FW (30) 27 (1) ✓ 1(1) 1 1 1s 1 – IN (49) 74 (46) ✓ 38 (1) 1 1 1 s 1 – IN (49) 75 (21) ✓ 6(1) 1 1 1s 1 D 373 FW (2649) 3482 (166) ✓ 43 (1) 1 1 3 s 22 – FW (2649) 16592 (1918) ✗ 67 (1) 1 1 33 min 49 E 31 IN (24) 57 (27) ✓ 4(3) 1 2 1s 10 – IN (24) 61 (45) ✗ 3(1) 1 1 1s 1 F 263 IN (261) 263 (263) ✓ 250 (3) 3 3 2 min 80 – IN (261) 265 (264) ✓ 250 (3) 3 3 3 min 57 G 68 IN (28) 20 (20) ✓ 8(5) 1 2 1s 8 – IN (28) 19 (19) ✗ 8(2) 2 2 1s 1 H 19 FW (20) 10 (10) ✗ 9(1) 1 1 1s 8 – FW (20) 8 (8) ✗ 3(1) 1 1 1s 1 222 C. Diekmann et al. Table 1 continued Fw Rules Chain (unfolded) Simple rules (no ifaces) Use Parts (ITVal) SS H H T T P Time (ITVal) Time (this) [s] I 15 FW (5) 4 (4) ✓ 4(4) 4 4 1s 8 – FW (5) 4 (4) ✓ 4(4) 4 4 1s 1 J 48 FW (12) 5 (5) ✓ 3(2) 2 2 1s 6 – FW (12) 8 (2) ✓ 1(1) 1 1 1s 1 K 21 FW (9) 7 (6) ✓ 3 (1) 1 1 1 s 12 – FW (9) 4 (3) ✓ 2(1) 1 1 1s 1 L 27 IN (16) 19 (19) ✓ 17 (3) 2 2 1 s 1 – IN (16) 18 (18) ✓ 17 (3) 2 2 1 s 1 M 80 IN (92) 64 (16) ✓ 2(2) 1 2 1s 6 – IN (92) 58 (27) ✗ 11 (1) 1 1 1 s 1 N 34 FW (14) 12 (12) ✓ 10 (6) 6 6 2 s 2 – FW (14) 12 (12) ✓ 10 (6) 6 6 2 s 1 O 8 IN (7) 9 (9) ✓ 3(3) 1 2 1s 1 – IN (7) 8 (8) ✓ 3(3) 1 2 1s 1 P 595 IN (15) 8 (8) ✓ 3(2) 2 2 1s 6 – IN (15) 9 (9) ✓ 3(2) 2 2 1s 6 595 FW (66) 64 (64) ✓ 60 (5) 5 4 22 s 6 – FW (66) 63 (63) ✓ 60 (5) 5 4 22 s 7 Q 58 IN (59) 65 (65) ✓ 21 (1) 1 1 2 s 2 – IN (59) 62 (62) ✓ 21 (2) 2 1 2 s 1 R 30 FW (28) 123 (123) ✓ 14 (1) 1 6 1 s 1 – FW (28) 20 (3) ✓ 2(2) 2 1 1s 1 ITVal memory consumption, in order of appearance: 84, 96, 94, 95, 61, 98, 96 and 21 GB Verified iptables Firewall Analysis and Verification 223 not require that the partition is minimal. Therefore, the following would be a valid solution: {{0} , {1} , ..., {255.255.255.255}}. However, we will need the partition as starting point for a further algorithm and a partition of size 2 (in case of IPv4) is too large for this purpose. In the case of IPv6, one address per partition would be infeasible. First, we motivate the idea of the partitioning algorithm with the following observation. For an arbitrary packet p,wewrite p(src → s) to fix the source IP address to s. Lemma 1 Let X be the set of all source IP matches specified in rs, i. e., X is a set of CIDR ranges. Given that we have a set B such that ∀ A ∈ X. B ⊆ A ∨ B ∩ A ={} holds. Then, for s ∈ B and s ∈ B, 1 2 simple-fw rs p(src → s ) = simple-fw rs p(src → s ) 1 2 Reading the lemma backwards, it states that all packets with arbitrary source IPs picked from B are treated equally by the firewall. Therefore, B is a member of an IP address range partition. The condition imposed on B is that for all source CIDR ranges which are matched on in the ruleset (called A in the lemma), B is either a subset of the range or disjoint to it. The lemma shows that this condition is sufficient for B, therefore we will construct an algorithm to compute B. For an arbitrary set X, this condition is purely set-theoretic and we can solve it independently from the firewall theory. For simplicity, we use finite sets and lists interchangeably. The algorithm partitions is structured as follows. The part function computes a single step and takes two parameters. The first parameter is a set S ∈ X, the second parameter TS is a set of sets and corresponds to the remaining set which will be partitioned. In the first call, we set TS to {UNIV}. Then, we repeatedly call part on all elements in X and thread through the results, i.e., partitions = foldr part X {UNIV} The step function part itself is implemented as follows: for a fixed S, part STS recurses over TS and splits the set such that the precondition of Lemma 1 holds. part S ({T }∪ TS) = (S ∩ T ) ∪ (T \ S) ∪ (part (S \ T ) TS) part S {} = {} The result size of calling part once can be up to two times the size of TS. This implies that |rules| the size of the partition of a complete firewall ruleset is in the order of O(2 ).However, the empirical evaluation shows that the resulting size for real-world rulesets is much better. While IP address ranges may overlap in a ruleset, they usually do not overlap in the worst possible way for all pairs of rules. Consequently, at least one of the sets S ∩ T or T \ S is usually empty. For example, for our largest firewall, the number of computed partitions is 10 times smaller than the number of rules. Our evaluation (Table 1 in Sect. 14) confirms that the number of partitions is usually less than the number of rules. Our algorithm fulfills the assumption of Lemma 1 for arbitrary X. Because IP addresses occur as source and destination in a ruleset, we use our partitioning algorithm where X is the set of all IPs found in the ruleset. The result is a partition where for any two IPs in the same partition, setting the source or destination of an arbitrary packet to one of the two IPs, the firewall behaves equally. This results in a stronger version of Lemma 1, which holds 123 224 C. Diekmann et al. without any assumption and also holds for both source and destination IPs simultaneously. In addition, the partition covers the complete IPv4 (or IPv6) address space. 12.2 Service Matrices The computed IP address space partition may not be minimal. This means that two different partitions may exhibit exactly the same behavior. Therefore, for manual firewall verification, these partitionings may be misleading. Marmorstein elaborates on this problem [49]. ITVal’s solution is to minimize the partitioning. We suggest to minimize the partitioning, but wrt a fixed service. The evaluation shows that the result is smaller and thus clearer. A fixed service corresponds to a fixed packet with arbitrary IPs. For example, we can define SSH as TCP, destination port 22, and arbitrary but fixed source port ≥ 1024. A service matrix describes the allowed accesses for a specific service over the complete IPv4 (or IPv6) address space. It can be visualized as a graph; for example, the ruleset of Fig. 6 is visualized in Fig. 7. An example of a service matrix for a firewall with several thousands of rules is showninFig. 8. For clarity, this figure uses symbolic names (e.g., servers) instead of IP addresses. The raw IP addresses can be found in Fig. 9. More complicated examples with highly fragmented IP ranges are shown in Figs. 10 and 11; those stem from the same firewall installation, but at a later time. All matrices are minimal, i.e., they cannot be compressed any further. First, we describe when a firewall exhibits the same behavior for arbitrary source IPs s , s 1 2 and a fixed packet p: ∀d. simple-fw rs p(src → s , dst → d) = simple-fw rs p(src → s , dst → d) 1 2 We say the firewall shows same behavior for a fixed service if, in addition, the analogue condition holds for destination IPs. We present a function groupWIs, which computes the minimal partitioning for a fixed service. The idea is to start with the output of the algorithm partitions and minimize it. For this, the full, square access control matrix for inbound and outbound connections of each partition member is generated. An entry m in this matrix denotes whether partition member i, j i is allowed to communicate with partition member j. In detail, an entry m is a pair of i, j Boolean values, where the first element denotes whether all IP addresses in i are allowed to communicate with all IP addresses in j and the second entry denotes whether all IP addresses in j are allowed to communicate with all IP addresses in i. To compute all the entries m , i, j the algorithm performs two calls (one for source IP and one for destination IP) to simple-fw for each pair of partition members. This can be done by taking arbitrary representatives from each member of the partition as source and destination address and executing simple-fw for the fixed packet with those fixed IPs. The matrix is minimized by merging partitions with equal behavior, i.e., merging equal rows in the matrix. This algorithm is quadratic in the number of partitions. An early evaluation [23] shows that it scales surprisingly well, even for large rulesets, since the number of partitions is usually small. 44 45 46 The algorithm is sound, complete, and generates minimal results. Consequently, groupWIs computes an equivalence relation over IP addresses with respect to a simple Formalization: theorem getParts_samefw [22]. Formalization: theorem getParts_complete [22]. Formalization: theorem build_ip_partition_same_fw [22]. Formalization: theorem build_ip_partition_complete [22]. Formalization: theorem build_ip_partition_same_fw_min [22]. 123 Verified iptables Firewall Analysis and Verification 225 firewall ruleset for a fixed service. Hence, we call the members of the output set of groupWIs equivalence classes. Any IP address is a representative for its equivalence class. Theorem 12 (groupWIs sound and generates minimal results) For any two IPs in any equivalence class of groupWIs, the firewall shows the same behavior for a fixed service. For any two arbitrary equivalence classes A and B in groupWIs, if we can find two IPs in A and B respectively where the firewall shows the same behavior for a fixed service, then A = B. Improving Performance. We assume that the ruleset has a default policy. Otherwise, we fall back to our previous, slower algorithm. Any simplified, well-formed iptables ruleset has a default policy though. The above algorithm performs calls to simple-fw for each pair of representatives in the partition. The algorithm is significantly slowed down by the quadratic number of calls to simple-fw. Instead of repeatedly executing simple-fw for all combinations of representatives as source and destination address, for a fixed service and fixed source address, we can pre-compute the set of all matching destination addresses with one iteration over the ruleset. The same holds for the matching source addresses. As a rough estimate, this brings down the quadratic number of calls to simple-fw to a linear number of iterations over the ruleset. Note that the asymptotic runtime is still quadratic. We have implemented this improved algorithm and proven that Theorems 12 and 13 still hold for it. The empirical evaluation shows that this improvement yields a tenfold speedup. Final Theorem. A service matrix is a square matrix where the number of rows (resp. columns) corresponds to the number of equivalence classes computed by groupWIs.Anentry m i, j in a service matrix should mean that all IP addresses in equivalence class i are allowed to communicate with all IP addresses in equivalence class j. This matrix may not be symmetric and it is not the same as the internal representation used in groupWIs.Sofar,Theorem 12 only gives guarantees about the layout of the matrix (i.e., rows and columns), but it does not guarantee that the content of the matrix (i.e., the permissions m ) has the desired property. i, j In addition, we don’t want to present a matrix, but we want to visualize the allowed accesses as graph, for example as shown in e.g., Figs. 7, 8, 9, 10, 11,or 12. Since a service matrix is a square matrix, it can be visualized as graph by treating it as an adjacency matrix. In this way, the function groupWIs only computes the nodes of the graph. To draw a graph, for example with TikZ [77] or Graphviz, one first needs to print the nodes and print the edges afterwards. The name of the nodes (representatives) should not be printed but the IP range they actually represent (equivalence classes). For example, the source code for Fig. 7 may be defined as follows: \begin{tikzpicture} \node (a) at (-4,-4) {$\{131.159.21.0 .. 131.159.21.255\}$}; \node (b) at (4,-4) {$\{131.159.15.240 .. 131.159.15.255\}$}; \node (c) at (0,-6) {$\{127.0.0.0 .. 127.255.255.255\}$}; ... \draw (a) to (b); \draw (c) to (a); Since we can easily check at runtime whether a ruleset has a default policy, this fallback solely exists for the purpose of stating our theorems without requiring the assumption of a default policy. Our faster algorithm (with default policy) and slower algorithm (without default policy) compute the same result. In practice, any ruleset has a default policy and the faster algorithm is always used. http://www.graphviz.org/. 123 226 C. Diekmann et al. \draw (c) to (b); \draw (c) to (c); ... \end{tikzpicture} In this example, the node names a, b,and c are identifiers which semantically correspond to the set of IP addresses described by their label. For example, a represents the equivalence class with the range from 131.159.21.0 to 131.159.21.255. The coordinates, for example (-4,-4) for node a are not relevant for our concerns. The edges mean that the complete IP ranges referenced by their representatives may communicate, e.g., \draw (a) to (b) means that the complete set 131.159.21.0/24 may establish connections to 131.159.15.240/28. In the final drawing, the identifiers a, b,and c are not shown but only their corresponding IP ranges. Agraph (V , E ) consists of a set of vertices V and a set of edges E ⊆ V × V . In our scenario, we have a map V where the keys are identifiers (a, b, c, …) which map to their equivalence class (set of IP addresses). We chose V to be the domain of V . Conveniently, the ˆ ˆ union of the range of V is the universe. We compute the keys of V by calling groupWIs and selecting a representative for each equivalence class (e.g., by taking the lowest IP address). We compute E by calling simple-fw for each pair of V × V.Notethat V is minimized and the empirical evaluation shows that this quadratic number of calls to simple-fw is not a performance problem. For convenience, we printed symbolic identifiers a, b, c,…forthe keys of V instead of IP addresses. We present a final theorem which justifies the correctness of graphs which are drawn according to our method. Theorem 13 (Service Matrix) Let (V , E ) be a service matrix. Then, ∃ s d s d .(s , d ) ∈ E ∧ repr repr range range repr repr Vs = Some s ∧ s ∈ s ∧ repr range range Vd = Some d ∧ d ∈ d repr range range ←→ simple-fw rs p(src → s, dst → d) = The theorem reads as follows: for a fixed connection, one can look up IP addresses (source s and destination d pairs) in the graph if and only if the firewall accepts this (s, d) IP address pair for the fixed connection. The part which complicates the formalization is the notion of “looking up IP addresses in the graph”. To look up a source IP address s in the graph, one first locates s as a member in one of the IP equivalence classes, here s . This equivalence class is represented by a repre- range sentative s . The same is done to obtain d . The theorem now says that (s , d ) ∈ E repr repr repr repr if and only if the firewall allows packets from s to d. The if-and-only-if relationship in combi- nation with the existential quantifier also implies that there is always exactly one equivalence class in which we can find s and d, which means that our graph always contains a complete and disjoint representation of the IP address space. Formalization: definition access_matrix, theorem access_matrix [22]. 123 Verified iptables Firewall Analysis and Verification 227 *filter :INPUT DROP [0:0] :FORWARD DROP [0:0] :OUTPUT DROP [0:0] :DOS_PROTECT - [0:0] :GOOD~STUFF - [0:0] -A FORWARD -j DOS_PROTECT -A FORWARD -j GOOD~STUFF -A FORWARD -p tcp -m multiport ! --dports 80,443,6667,6697 -m hashlimit ← --hashlimit-above 10/sec --hashlimit-burst 20 --hashlimit-mode srcip ← --hashlimit-name aflood --hashlimit-srcmask 8 -j LOG -A FORWARD ! -i lo -s 127.0.0.0/8 -j DROP -A FORWARD -i internal -s 131.159.21.0/24 -j ACCEPT -A FORWARD -s 131.159.15.240/28 -d 131.159.21.0/24 -j DROP -A FORWARD -p tcp -d 131.159.15.240/28 -j ACCEPT -A FORWARD -i -p tcp -s 131.159.15.240/28 -j ACCEPT -A GOOD~STUFF -i lo -j ACCEPT -A GOOD~STUFF -m state --state ESTABLISHED -j ACCEPT -A GOOD~STUFF -p icmp -m state --state RELATED -j ACCEPT -A DOS_PROTECT -i eth1 -p icmp -m icmp --icmp-type 8 ... --limit 1/sec -j RETURN -A DOS_PROTECT -i eth1 -p icmp -m icmp --icmp-type 8 -j DROP COMMIT Fig. 6 Example ruleset. (Color figure online) 13 Stand-Alone Haskell Tool fffuu We used Isabelle’s code generation features [34,35] to build a stand-alone tool in Haskell. Since all analysis and transformation algorithms are written in Isabelle, we only needed to add parsers and user interface. Overall, more than 80% of the code is generated by Isabelle, which gives us strong trust in the tool. We call our tool fffuu,the “f ancy f ormal f irewall universal understander”. fffuu requires only one parameter to run, namely, an iptables-save dump. This makes it very usable. Optionally, one may pass an ipassmt, change the table or chain which is loaded, pass a routing table for output port rewriting, or select the services for the service matrix. fffuu can be easily compiled from source using stack, which ensures reproducible builds well into the future. Example. We demonstrate fffuu by a small example. We want to infer the intention behind the ruleset shown in Fig. 6. Though this ruleset was artificially crafted to demonstrate certain corner cases, it is based on actual rules from real-world firewalls [3,16]. Also note that the \e[31m \e[0m (rendered as ) interface name with UTF-8 symbols and shell escapes for color [53] is perfectly valid. It is hard to guess what the ruleset is implementing. We load the ruleset into fffuu, not requiring any additional parameters or manual steps to compute it. The resulting service matrix (for arbitrary ports) is shown in Fig. 7 and provides insight into the intention of the ruleset. An arrow from one IP range to another IP range indicates that the first range may set up connections with the second. At the bottom, we see the localhost range of 127.0.0.0/8. The reflexive arrow (localhost to localhost) shows that the firewall does not block its own localhost traffic, which is usually https://docs.haskellstack.org/en/stable/README/. 123 228 C. Diekmann et al. {0.0.0.0..126.255.255.255}∪ {128.0.0.0..131.159.15.239}∪ {131.159.16.0..131.159.20.255}∪ {131.159.22.0..255.255.255.255} {131.159.21.0..131.159.21.255}{131.159.15.240..131.159.15.255} {127.0.0.0..127.255.255.255} Fig. 7 Service matrix of ruleset in Fig. 6 a good sign. However, localhost traffic is usually not interesting for a firewall analysis since this range is usually not routed [15]. We will ignore it from now. On the top, in the cloud, we see a large set of IP addresses. This corresponds to the Internet. On the left, we see the 131.159.21.0/24 range. It may access the Internet and the 131.159.15.240/28 range. On the right, we see the 131.159.15.240/28 range, which may only access the Internet, but not the 131.159.21.0/24 range. Carefully looking at the figure, we might recognize the overall architecture: the fire- wall implements the “Demilitarized Zone” (DMZ) architectural pattern. This can usually be described as a local network that is segmented into two parts; a public one that is reach- able from the outside Internet (hosting services that need to be reachable from the outside, e.g., a mail or a web server) and an internal one that can only connect to the Internet, but not the opposite direction. To mitigate a situation where some host in the public segment gets compromised, the firewall also prohibits connection from the public into the internal segment. Starting from the original iptables-save input, without the help of fffuu,this architecture would have been difficult to uncover and verify. 14 Evaluation We obtained real-world rulesets from over 15 firewalls. Some are central, production-critical devices. They are written by different authors, utilize a vast amount of different features and exhibit different styles and patterns. The fact that we publish the complete rulesets is an important contribution (cf. Wool [82,84]). To the best of our knowledge, this is the largest, publicly available collection of real-world iptables rulesets. Note: some administrators wish 123 Verified iptables Firewall Analysis and Verification 229 to remain anonymous so we replaced their public IP addresses with public IP ranges of our institute, preserving all IP subset relationships. Table 1 summarizes the evaluation’s results. The first column (“Fw”) labels the analyzed ruleset. Column 2 (“Rules”) contains the number of rules (only the filter table) in the output of iptables-save. We work directly on these real-world data sets. Column 3 describes the analyzed chain. Depending on the type of firewall, we either analyzed the FORWARD (“FW”) or the INPUT (“IN”) chain. For a host firewall, we analyzed IN; for a network firewall, e.g., on a gateway or router, we analyzed FW. In parentheses, we wrote the number of rules after unfolding the analyzed chain. The unfolding also features some generic, straight-forward optimizations, such as removing rules where the match expression is ¬ Any. Column 4 (“Simple rules”) is the number of rules when translated to the simple firewall. In parentheses, we wrote the number of simple firewall rules when interfaces are removed. This ruleset is used subsequently to compute the partitions and service matrices. In column 5 (“Use”), we mark whether the translated simple firewall is useful. We will detail on the metric later. Column 6 (“Parts”) lists the number of IP address space partitions. For comparison, we give the number of partitions computed by ITVal in parentheses. In Columns 7 and 8, we give the number of partitions for the service matrices for SSH and HTTP. In column 9 (“Time (ITVal)”), for comparison, we put the runtime of the partitioning by ITVal in parentheses in seconds, minutes, or hours. In column 10 (“Time (this)”), we give the overall runtime of our analysis. When translating to the simple firewall, to accomplish support for arbitrary matching primitives, some approximations need to be performed. For every firewall, the first row states the overapproximation (more permissive), the second row the underapproximation (more strict). In contrast to the intermediate evaluation, there is no longer the need to manually exclude certain rules from the analysis (cf. Sect. 6.4). For some rulesets, we do not know the interface configuration. For others, there were zone-spanning interfaces. For these reasons, as proven in Sect. 11.6, in the majority of cases, we could not rewrite interfaces. This is one reason for the differences between over- and underapproximation. We loaded all translated simple firewall rulesets (without interfaces) with iptables-res tore. This validates that our results are well-formed. We then used iptables directly to gen- erate the firewall format required by ITVal (iptables -L -n). Our translation to the simple firewall is required because ITVal cannot understand the original complex rulesets and produces flawed results for them. Performance. We have two possibilities to execute our algorithms, depending on whether the user wants to run them inside of Isabelle or as an external stand-alone application [34]. For our evaluation, we utilize Isabelle’s code reflection capabilities. In essence, it gives us a way to execute our algorithms as if they were implemented in Isabelle’s implementation language (Standard ML). Isabelle’s code generator introduces its own unoptimized version for data structures that are already present in the standard libraries of many programming languages. Hence, the generated code may be quite inefficient. For example, lookups in Isabelle-generated dictionaries have linear lookup time, compared to constant lookup time of standard library implementations. In contrast, ITVal is highly optimized C++ code. We benchmarked our tool on a commodity i7-2620M laptop with 2 physical cores and 8 GB of RAM. In contrast, we executed ITVal on a server with 16 physical Xeon E5-2650 cores There are methods to improve the performance and provably preserve correctness [43,44], which are out of the scope of this article. 123 230 C. Diekmann et al. and 128 GB RAM. The runtime measured for our tool is the complete translation to the two simple firewalls, computation of partitions, and the two service matrices. In contrast, the runtime of ITVal only consists of computing one partition. The reported time of our tool also includes the runtime of Isabelle’s code generator, but for ITVal we did not add its compilation time. This is one reason why ITVal outperforms our tool for runtimes of <1min. These benchmark settings are biased against our tool. Indeed, exporting our tool to a stan- dalone Haskell application instead, replacing some common data structures with optimized ones from the Haskell standard library, enabling aggressive compiler optimization and paral- lelization, not counting compilation time, and running our tool on the Xeon server, the runtime of our tool improves by orders of magnitude. Our stand-alone tool fffuu also achieves a better runtime by orders of magnitude. Nevertheless, we chose the “unfair” setting to demonstrate the feasibility of running verified code directly in a theorem prover. Table 1 shows that our tool outperforms ITVal for large firewalls. We added ITVal’s memory requirements to the table if they exceeded 20 GB. ITVal requires an infeasible amount of memory for larger rulesets while our tool can finish on commodity hardware. The overall numbers show that the runtime for our tool is sufficient for static, offline analysis, even for large real-word rulesets. For our daily use and convenience, we use our Haskell tool fffuu which adds another order of magnitude of speedup to our numbers of Table 1. Quality of results. The main goal of ITVal is to compute a minimal partitioning while ours may not be minimal. A smaller number of partitions is better, since the result is more over- seeable. It can be seen that ITVal provides better results than our approach in Column 6. Since a service matrix is more specific than a partitioning, the partitions of a service matrix (Column 7 and 8) can be even smaller. Our service matrices are provably minimal and thus improve on ITVal’s partitioning. Since a partitioning cannot be smaller than a service matrix, the numbers in Column 6 must be greater or equal than the numbers in Column 7 or 8. For firewalls A and R, it can be seen that ITVals’s results are spurious, while ours are provably correct. In general, if the number of partitions calculated by ITVal is smaller than those of a service matrix, this is an error in ITVal. In Column 5, we show the usefulness of the translated simple firewall (including interfaces). We deem a firewall useful if interesting information was preserved by the approxi- mation. Therefore, we manually inspected the rulesest and compared it to the original. For the overapproximation, we focused on preserved (non-shadowed) Drop rules. For the underap- proximation, we focused on preserved (non-shadowed) Accept rules. If the firewall features some rate-limiting for all packets in the beginning, the underapproximation is naturally a drop- all ruleset because the rate-limiting could apply to all packets. According to our metric, such a ruleset is of no use (but the only sound solution). We indicate this case with a superscript . The table indicates that, usually, at least one approximation per firewall is useful. For brevity, we only elaborate on the most interesting rulesets and consequences of their analysis. Firewall A. This firewall is the core firewall of our lab (Chair of Network Architectures and Services). It has two uplinks, interconnects several VLANs, and matches on more than 20 interfaces. It has around 500 direct users and one transfer network for an autonomous system (AS) behind it. The traffic is usually several Mbit/s. We have analyzed dumps from Oct 2013, Sep 2014, May 2015, and Sep 2015. The changing number of rules indicates that it is actively managed. 123 Verified iptables Firewall Analysis and Verification 231 The firewall starts with some rate-limiting rules. Therefore, its stricter approximation assumes that the rate-limiting always applies and transforms the ruleset into a deny-all ruleset. The more permissive approximation abstracts over this rate-limiting and provides a very good approximation of the original ruleset. The SSH service matrix is visualized in Fig. 8 and in Fig. 9 with the raw IP addresses. The figure can be read as follows: the vast majority of our IP addresses are grouped into internal and servers. Servers are reachable from the outside, internal hosts are not. ip and ip are two individual IP addresses with special exceptions. There is also a group for the backbone routers of the connected AS. INET is the set of IP addresses which does not belong to us, basically the Internet. INET’ is another part of the Internet. With the help of the service matrix, the administrator confirmed that the existence of INET’ was an error caused by a stale rule. The misconfiguration has been fixed. Figure 8 summarizes over 4000 firewall rules and helps to easily visually verify the complex SSH setup of our firewall. The administrator was also interested in the Kerberos (kerberos-adm) and LDAP service matrices. They helped verifying the complex setup and discovered potential for ruleset cleanup. We have used the fffuu tool further on to analyze our firewall. For example, Figs. 10 (IPv4) and 11 (IPv6) were created from a recent snapshot of June 2016 and depict the service matrix for HTTP. This snapshot is not listed in the table. The figures show the raw IP addresses. It can be seen that the “two INETs” bug has been fixed, but the overall complexity of the firewall increased. Note that the service matrix is minimal, i.e., there is no way to compress it any further. The two figures reveal the intrinsic complexity of this firewall. However, the figures, though complicated, can still be visualized on one page. This would be impossible for the thousands of rules of the actual ruleset. It demonstrates that our service matrices can give a suitable overview of complicated rulesets. Firewall D. This firewall was taken from a Shorewall system with 373 rules and 65 chains. It can be seen that unfolding increases the number of rules, because of the complex call structures generated by the user-defined chains. Transforming to the simple firewall further increases the ruleset size. This is, among other reasons, due to rewriting several negated IP matches back to non-negated CIDR ranges and NNF normalization. However, the absolute numbers tell us that this blow up is no problem for computerized analysis. multicast ip INET INET’ servers AS routers localhost ip internal Fig. 8 Lab SSH Service Matrix (2015) 123 232 C. Diekmann et al. {224.0.0.0..239.255.255.255} {0.0.0.0..126.255.255.255}∪{128.0.0.0..131.158.255.255}∪ 131.159.15.54 {131.160.0.0..138.246.253.4}∪{138.246.253.6..185.86.231.255}∪ {185.86.236.0..188.1.239.85}∪{188.1.239.87..188.95.232.63}∪ {188.95.232.224..188.95.232.255}∪{188.95.240.0..192.48.106.255}∪ {192.48.108.0..223.255.255.255}∪{240.0.0.0..255.255.255.255} {131.159.14.8..131.159.14.11}∪131.159.14.22 ∪131.159.14.26 ∪131.159.14.28 ∪188.1.239.86 ∪{188.95.232.64..188.95.232.191} {131.159.14.34..131.159.14.37}∪131.159.14.40∪131.159.14.42∪131.159.14.52∪ 131.159.14.56∪131.159.14.58∪131.159.14.69∪131.159.14.83∪131.159.14.104∪ 131.159.14.111 ∪ 131.159.14.125 ∪ 131.159.14.137 ∪ 131.159.14.140 ∪ {131.159.14.145..131.159.14.146}∪{131.159.14.155..131.159.14.156}∪ 131.159.14.163 ∪ 131.159.14.169 ∪ 131.159.14.201 ∪ 131.159.14.214 ∪ 131.159.15.5∪{131.159.15.7..131.159.15.13}∪{131.159.15.16..131.159.15.20}∪ {131.159.15.23..131.159.15.25}∪ 131.159.15.27 ∪ 131.159.15.29 ∪ 131.159.15.32∪131.159.15.36∪131.159.15.39∪{131.159.15.42..131.159.15.44}∪ {131.159.15.47..131.159.15.48}∪ 131.159.15.56 ∪ 131.159.15.58 ∪ 131.159.15.60 ∪ 131.159.15.69 ∪ 131.159.15.197 ∪ 131.159.15.228 ∪ 131.159.15.234 ∪{131.159.15.247..131.159.15.249}∪ 131.159.20.21 ∪ {131.159.20.29..131.159.20.30}∪131.159.20.36∪131.159.20.45∪131.159.20.52∪ {131.159.0.0..131.159.13.255}∪ 131.159.20.59 ∪131.159.20.63 ∪131.159.20.71 ∪131.159.20.74 ∪131.159.20.85 ∪ {131.159.16.0..131.159.19.255}∪ 131.159.20.97 ∪ 131.159.20.118 ∪ 131.159.20.120 ∪ 131.159.20.124 ∪ {131.159.22.0..131.159.255.255} 131.159.20.139 ∪{131.159.20.150..131.159.20.151}∪ 131.159.20.155 ∪ 131.159.20.160 ∪{131.159.20.165..131.159.20.166}∪ 131.159.20.180 ∪ 131.159.20.185 ∪ 131.159.20.200 ∪{131.159.20.233..131.159.20.234}∪ {131.159.21.0..131.159.21.255}∪{188.95.232.192..188.95.232.223}∪ 188.95.233.4 ∪ 188.95.233.9 ∪{188.95.234.0..188.95.239.255} 138.246.253.5 {131.159.14.0..131.159.14.7}∪{131.159.14.12..131.159.14.21}∪ {131.159.14.23..131.159.14.25}∪ 131.159.14.27 ∪ {127.0.0.0..127.255.255.255} {131.159.14.29..131.159.14.33}∪{131.159.14.38..131.159.14.39}∪ 131.159.14.41 ∪{131.159.14.43..131.159.14.51}∪ {131.159.14.53..131.159.14.55}∪ 131.159.14.57 ∪ {131.159.14.59..131.159.14.68}∪{131.159.14.70..131.159.14.82}∪ {131.159.14.84..131.159.14.103}∪{131.159.14.105..131.159.14.110}∪ {131.159.14.112..131.159.14.124}∪{131.159.14.126..131.159.14.136}∪ {131.159.14.138..131.159.14.139}∪{131.159.14.141..131.159.14.144}∪ {131.159.14.147..131.159.14.154}∪{131.159.14.157..131.159.14.162}∪ {131.159.14.164..131.159.14.168}∪{131.159.14.170..131.159.14.200}∪ {131.159.14.202..131.159.14.213}∪{131.159.14.215..131.159.15.4}∪ 131.159.15.6 ∪{131.159.15.14..131.159.15.15}∪ {131.159.15.21..131.159.15.22}∪ 131.159.15.26 ∪ 131.159.15.28 ∪ {131.159.15.30..131.159.15.31}∪{131.159.15.33..131.159.15.35}∪ {131.159.15.37..131.159.15.38}∪{131.159.15.40..131.159.15.41}∪ {131.159.15.45..131.159.15.46}∪{131.159.15.49..131.159.15.53}∪ 131.159.15.55∪131.159.15.57∪131.159.15.59∪{131.159.15.61..131.159.15.68}∪ {131.159.15.70..131.159.15.196}∪{131.159.15.198..131.159.15.227}∪ {131.159.15.229..131.159.15.233}∪{131.159.15.235..131.159.15.246}∪ {131.159.15.250..131.159.15.255}∪{131.159.20.0..131.159.20.20}∪ {131.159.20.22..131.159.20.28}∪{131.159.20.31..131.159.20.35}∪ {131.159.20.37..131.159.20.44}∪{131.159.20.46..131.159.20.51}∪ {131.159.20.53..131.159.20.58}∪{131.159.20.60..131.159.20.62}∪ {131.159.20.64..131.159.20.70}∪{131.159.20.72..131.159.20.73}∪ {131.159.20.75..131.159.20.84}∪{131.159.20.86..131.159.20.96}∪ {131.159.20.98..131.159.20.117}∪ 131.159.20.119 ∪ {131.159.20.121..131.159.20.123}∪{131.159.20.125..131.159.20.138}∪ {131.159.20.140..131.159.20.149}∪{131.159.20.152..131.159.20.154}∪ {131.159.20.156..131.159.20.159}∪{131.159.20.161..131.159.20.164}∪ {131.159.20.167..131.159.20.179}∪{131.159.20.181..131.159.20.184}∪ {131.159.20.186..131.159.20.199}∪{131.159.20.201..131.159.20.232}∪ {131.159.20.235..131.159.20.255}∪{185.86.232.0..185.86.235.255}∪ {188.95.233.0..188.95.233.3}∪{188.95.233.5..188.95.233.8}∪ {188.95.233.10..188.95.233.255}∪{192.48.107.0..192.48.107.255} Fig. 9 Lab SSH Service Matrix with raw IP addresses (2015) Roughly speaking, the firewall connects interfaces to each other, i.e., it heavily uses -i and -o. This can be easily seen in the overapproximation. There are also many zone-spanning interfaces. As we have proven, it is impossible to rewrite interfaces in this case. In addition, for some interfaces, no IP ranges are specified. Hence, this ruleset is more of a link layer firewall than a network layer firewall. Consequently, the service matrices are barely of any use. Later on, having obtained more detailed interface and routing configurations, we tried again with input and output port rewriting. The result is not shown in the table, but visualized in Fig. 12. The figure now correctly summarizes the network architecture enforced by the firewall. It shows the general Internet, a Debian update server (141.76.2.4), and four internal networks with different access rights. Firewall E. This ruleset was taken from a NAS device from the introduction (Fig. 1). The ruleset first performs some rate-limiting. Consequently, the underapproximation corresponds to the deny-all ruleset. The table lists a more recent version of the ruleset after a system update. Our SSH service matrix reveals a misconfiguration: SSH was accidentally left enabled after 123 Verified iptables Firewall Analysis and Verification 233 {0.0.0.0..45.56.113.32}∪{45.56.113.34..80.81.195.255}∪ {80.81.197.0..81.169.253.163}∪{81.169.253.165..85.214.129.213}∪ {85.214.129.215..94.186.159.97}∪ {94.186.159.99..126.255.255.255}∪{128.0.0.0..131.159.13.255}∪ {131.159.16.0..131.159.19.255}∪{131.159.22.0..138.246.252.255}∪ {138.246.254.0..148.251.90.44}∪{148.251.90.46..185.86.231.255}∪ {185.86.236.0..188.1.239.85}∪{188.1.239.87..188.95.232.63}∪ {188.95.232.224..188.95.232.255}∪{188.95.240.0..192.48.106.255}∪ {192.48.108.0..223.255.255.255}∪{240.0.0.0..255.255.255.255} {131.159.14.0..131.159.14.10}∪{131.159.14.12..131.159.14.25}∪ 131.159.14.11 ∪ 131.159.14.26 ∪ 131.159.14.36 ∪ 131.159.14.42 ∪ 131.159.14.47 ∪ 131.159.14.60 ∪ 131.159.14.63 ∪ 131.159.14.85 ∪ {131.159.14.27..131.159.14.35}∪{131.159.14.37..131.159.14.41}∪ 131.159.14.125 ∪ 131.159.14.140 ∪{131.159.14.145..131.159.14.146}∪ {131.159.14.43..131.159.14.46}∪{131.159.14.48..131.159.14.59}∪ 131.159.14.169 ∪ 131.159.14.204 ∪ 131.159.14.214 ∪ 131.159.14.221 ∪ {131.159.14.61..131.159.14.62}∪{131.159.14.64..131.159.14.84}∪ {131.159.15.4..131.159.15.5}∪ 131.159.15.7 ∪ 131.159.15.9 ∪ 131.159.15.11 ∪ {131.159.14.86..131.159.14.124}∪{131.159.14.126..131.159.14.139}∪ {131.159.14.141..131.159.14.144}∪{131.159.14.147..131.159.14.168}∪ {131.159.15.13..131.159.15.14}∪{131.159.15.16..131.159.15.17}∪ {131.159.14.170..131.159.14.203}∪{131.159.14.205..131.159.14.208}∪ {131.159.15.20..131.159.15.21}∪ 131.159.15.23 ∪ {131.159.14.210..131.159.14.211}∪ 131.159.14.213 ∪ {131.159.15.26..131.159.15.27}∪{131.159.15.29..131.159.15.36}∪ {131.159.14.217..131.159.14.220}∪{131.159.14.222..131.159.15.3}∪ {131.159.15.38..131.159.15.39}∪ 131.159.15.6 ∪ 131.159.15.8 ∪ 131.159.15.10 ∪ 131.159.15.12 ∪ 131.159.15.15 ∪ {131.159.15.41..131.159.15.42..131.159.15.44}∪ {131.159.15.18..131.159.15.19}∪ 131.159.15.22 ∪ {131.159.15.46..131.159.15.49}∪ 131.159.15.51 ∪ {131.159.15.24..131.159.15.25}∪131.159.15.28∪131.159.15.37∪131.159.15.40∪ {131.159.15.53..131.159.15.54}∪{131.159.15.56..131.159.15.59}∪ 131.159.15.68 ∪ 131.159.15.226 ∪ 131.159.15.229 ∪ 131.159.15.233 ∪ 131.159.15.45∪131.159.15.52∪131.159.15.55∪{131.159.15.60..131.159.15.67}∪ {131.159.15.246..131.159.15.248}∪ 131.159.20.42 ∪ 131.159.20.45 ∪ {131.159.15.69..131.159.15.225}∪{131.159.15.227..131.159.15.228}∪ 131.159.20.52 ∪ 131.159.20.59 ∪ 131.159.20.72 ∪ 131.159.20.155 ∪ {131.159.15.230..131.159.15.232}∪{131.159.15.234..131.159.15.245}∪ 131.159.20.202 ∪ 131.159.20.243 ∪{131.159.21.0..131.159.21.255}∪ {131.159.15.249..131.159.15.255}∪{131.159.20.0..131.159.20.41}∪ {131.159.20.43..131.159.20.44}∪{131.159.20.46..131.159.20.51}∪ {185.86.232.0..185.86.235.255}∪{188.95.232.192..188.95.232.223}∪ {131.159.20.53..131.159.20.58}∪{131.159.20.60..131.159.20.71}∪ {188.95.233.4..188.95.233.5}∪ 188.95.233.9 ∪{188.95.234.0..188.95.239.255} {131.159.20.73..131.159.20.154}∪{131.159.20.156..131.159.20.201}∪ {131.159.20.203..131.159.20.242}∪{131.159.20.244..131.159.20.255}∪ {188.95.233.0..188.95.233.3}∪{188.95.233.6..188.95.233.8}∪ {188.95.233.10..188.95.233.255}∪{192.48.107.0..192.48.107.255} {138.246.253.6..138.246.253.10}∪ 138.246.253.19 {224.0.0.0..239.255.255.255} {127.0.0.0..127.255.255.255} 131.159.14.212 ∪ {131.159.14.215..131.159.14.216} 138.246.253.5 131.159.15.50 {80.81.196.0..80.81.196.255} 45.56.113.33 ∪ 81.169.253.164 ∪ 188.1.239.86 ∪{188.95.232.64..188.95.232.191} 85.214.129.214 ∪ 94.186.159.98 ∪ 148.251.90.45 131.159.14.209 {138.246.253.0..138.246.253.4}∪ {138.246.253.11..138.246.253.18}∪ {138.246.253.20..138.246.253.255} Fig. 10 Lab IPv4 HTTP Service Matrix (2016) the update. After this discovery, the flaw was fixed. The service matrix for the other services provided by the NAS (not listed in the table) verifies that these services are only accessible from the local network. This finally yields the expected result as motivated in the introduction. Firewall F. This firewall is running on a publicly accessible server. The firewall first allows everything for localhost, then blocks IP addresses which have shown malicious behavior in the past, and finally allows certain services. Since most rules are devoted to blocking malicious IPs, our IP address space partition roughly grows linearly with the number of rules. The service matrices, however, reveal that there are actually only three classes of IP ranges: localhost, the blocked IPs, and all other IPs which are granted access to the services. Firewall G. For this production server, the service matrices verified that a SQL daemon is only accessible from a local network and three explicitly-defined public IP addresses. Our tool could verify the belief of the administrator that the firewall is configured correctly. 123 234 C. Diekmann et al. :: ∪{::2 .. 2001:638:c:a09d::1}∪{2001:638:c:a09d::3 .. 2001:4ca0:108:41:ffff:ffff:ffff:ffff}∪ {2001:4ca0:108:43:: .. 2001:4ca0:2001:9:ffff:ffff:ffff:ffff}∪{2001:4ca0:2001:b:: .. 2001:4ca0:2001:f:ffff:ffff:ffff:ffff}∪{2001:4ca0:2001:16:: .. 2001:4ca0:2001:16:ffff:ffff:ffff:ffff}∪ {2001:4ca0:2001:1a:: .. 2001:4ca0:2001:1f:ffff:ffff:ffff:ffff}∪{2001:4ca0:2001:22:: .. 2001:4ca0:2001:2f:ffff:ffff:ffff:ffff}∪{2001:4ca0:2001:31:: .. 2001:4ca0:2001:3f:ffff:ffff:ffff:ffff}∪ {2001:4ca0:2001:41:: .. 2001:4ca0:2001:41:ffff:ffff:ffff:ffff}∪{2001:4ca0:2001:43:: .. 2600:3c02::f03c:91ff:fe84:a74}∪{2600:3c02::f03c:91ff:fe84:a76 .. 2a00:4700::ffff:ffff:ffff:ffff}∪ {2a00:4700:0:8:: .. 2a00:4700:0:8:ffff:ffff:ffff:ffff}∪{2a00:4700:0:a:: .. 2a01:238:4270:b800:a7dc:c448:3f2:3ce2}∪{2a01:238:4270:b800:a7dc:c448:3f2:3ce4 .. 2a01:238:43d7:c300:74c7:3bfe:cceb:ee02}∪{2a01:238:43d7:c300:74c7:3bfe:cceb:ee04 .. 2a01:4f8:202:702c::1}∪{2a01:4f8:202:702c::3 .. feff:ffff:ffff:ffff:ffff:ffff:ffff:ffff} 2001:638:c:a09d::2 ∪{2001:4ca0:2001:10:: .. 2001:4ca0:2001:10:201:80ff:fe7f:6d86}∪{2001:4ca0:2001:10:201:80ff:fe7f:6d88 .. {2001:4ca0:2001:a:: .. 2001:4ca0:2001:a:ffff:ffff:ffff:ffff}∪ 2001:4ca0:2001:10:201:80ff:fe7f:6d87 ∪ 2001:4ca0:2001:10:211:2fff:feb5:9192}∪{2001:4ca0:2001:10:211:2fff:feb5:9194 .. 2001:4ca0:2001:10:214:bff:fe60:16f3}∪ 2001:4ca0:2001:10:211:2fff:feb5:9193 ∪ 2001:4ca0:2001:10:214:bff:fe60:16f4 ∪ 2001:4ca0:2001:10:216:3eff:fe38:14e1 ∪ {2001:4ca0:2001:10:214:bff:fe60:16f5 .. 2001:4ca0:2001:10:216:3eff:fe38:14e0}∪{2001:4ca0:2001:10:216:3eff:fe38:14e2 .. 2001:4ca0:2001:10:216:3eff:fe51:7871 ∪ 2001:4ca0:2001:10:216:3eff:fe68:84d3 ∪ 2001:4ca0:2001:10:225:90ff:fedb:c720 ∪ 2001:4ca0:2001:10:216:3eff:fe51:7870}∪{2001:4ca0:2001:10:216:3eff:fe51:7872 .. 2001:4ca0:2001:10:216:3eff:fe68:84d2}∪ 2001:4ca0:2001:10:230:48ff:febb:4bca ∪ 2001:4ca0:2001:10:2e0:81ff:fec6:74bd ∪{2001:4ca0:2001:10:2e0:81ff:fec6:75fe .. {2001:4ca0:2001:10:216:3eff:fe68:84d4 .. 2001:4ca0:2001:10:225:90ff:fedb:c71f}∪{2001:4ca0:2001:10:225:90ff:fedb:c721 .. 2001:4ca0:2001:10:2e0:81ff:fec6:75ff}∪ 2001:4ca0:2001:11:210:18ff:fe91:1901 ∪ 2001:4ca0:2001:11:214:bff:fe6f:2ab1 ∪ 2001:4ca0:2001:10:230:48ff:febb:4bc9}∪{2001:4ca0:2001:10:230:48ff:febb:4bcb .. 2001:4ca0:2001:10:2e0:81ff:fec6:74bc}∪ 2001:4ca0:2001:11:216:3eff:fe07:16f9 ∪ 2001:4ca0:2001:11:225:90ff:fe7a:cb82 ∪ 2001:4ca0:2001:11:225:90ff:fed7:8914 ∪ {2001:4ca0:2001:10:2e0:81ff:fec6:74be .. 2001:4ca0:2001:10:2e0:81ff:fec6:75fd}∪{2001:4ca0:2001:10:2e0:81ff:fec6:7600 .. 2001:4ca0:2001:11:226:22ff:fea1:2382 ∪ 2001:4ca0:2001:11:226:b9ff:fe7d:84ed ∪ 2001:4ca0:2001:11:2e0:81ff:fe2d:f16 ∪ 2001:4ca0:2001:11:210:18ff:fe91:1900}∪{2001:4ca0:2001:11:210:18ff:fe91:1902 .. 2001:4ca0:2001:11:214:bff:fe6f:2ab0}∪ 2001:4ca0:2001:11:be30:5bff:fed4:bfee ∪ 2001:4ca0:2001:13::42 ∪ 2001:4ca0:2001:13:216:3eff:fe03:34f8 ∪ {2001:4ca0:2001:11:214:bff:fe6f:2ab2 .. 2001:4ca0:2001:11:216:3eff:fe07:16f8}∪{2001:4ca0:2001:11:216:3eff:fe07:16fa .. 2001:4ca0:2001:13:216:3eff:fe04:da66 ∪ 2001:4ca0:2001:13:216:3eff:fe10:a5d9 ∪ 2001:4ca0:2001:13:216:3eff:fe16:d255 ∪ 2001:4ca0:2001:11:225:90ff:fe7a:cb81}∪{2001:4ca0:2001:11:225:90ff:fe7a:cb83 .. 2001:4ca0:2001:11:225:90ff:fed7:8913}∪ 2001:4ca0:2001:13:216:3eff:fe1c:a6f5 ∪ 2001:4ca0:2001:13:216:3eff:fe30:d8c7 ∪{2001:4ca0:2001:13:216:3eff:fe32:c969 .. {2001:4ca0:2001:11:225:90ff:fed7:8915 .. 2001:4ca0:2001:11:226:22ff:fea1:2381}∪{2001:4ca0:2001:11:226:22ff:fea1:2383 .. 2001:4ca0:2001:13:216:3eff:fe32:c96a}∪ 2001:4ca0:2001:13:216:3eff:fe39:a31f ∪ 2001:4ca0:2001:13:216:3eff:fe45:42 ∪ 2001:4ca0:2001:11:226:b9ff:fe7d:84ec}∪{2001:4ca0:2001:11:226:b9ff:fe7d:84ee .. 2001:4ca0:2001:11:2e0:81ff:fe2d:f15}∪ 2001:4ca0:2001:13:216:3eff:fe50:e76b ∪ 2001:4ca0:2001:13:216:3eff:fe5b:5e87 ∪ 2001:4ca0:2001:13:216:3eff:fe5f:b83f ∪ {2001:4ca0:2001:11:2e0:81ff:fe2d:f17 .. 2001:4ca0:2001:11:be30:5bff:fed4:bfed}∪{2001:4ca0:2001:11:be30:5bff:fed4:bfef .. 2001:4ca0:2001:13:216:3eff:fe60:442a ∪ 2001:4ca0:2001:13:216:3eff:fe6e:ade7 ∪ 2001:4ca0:2001:13:216:3eff:fe75:7acd ∪ 2001:4ca0:2001:13::41}∪{2001:4ca0:2001:13::43 .. 2001:4ca0:2001:13:216:3eff:fe03:34f7}∪{2001:4ca0:2001:13:216:3eff:fe03:34f9 2001:4ca0:2001:13:216:3eff:fe76:6aae ∪ 2001:4ca0:2001:13:216:3eff:fe96:6bbc ∪ 2001:4ca0:2001:13:216:3eff:fea0:37e5 ∪ .. 2001:4ca0:2001:13:216:3eff:fe04:da65}∪{2001:4ca0:2001:13:216:3eff:fe04:da67 .. 2001:4ca0:2001:13:216:3eff:fe10:a5d8}∪ 2001:4ca0:2001:13:216:3eff:fea6:878b ∪ 2001:4ca0:2001:13:216:3eff:fea7:6ad5 ∪ 2001:4ca0:2001:13:216:3eff:fea8:cbf3 ∪ {2001:4ca0:2001:13:216:3eff:fe10:a5da .. 2001:4ca0:2001:13:216:3eff:fe16:d254}∪{2001:4ca0:2001:13:216:3eff:fe16:d256 .. 2001:4ca0:2001:13:216:3eff:fead:288c ∪ 2001:4ca0:2001:13:216:3eff:feb0:5c43 ∪ 2001:4ca0:2001:13:216:3eff:fec2:1264 ∪ 2001:4ca0:2001:13:216:3eff:fe1c:a6f4}∪{2001:4ca0:2001:13:216:3eff:fe1c:a6f6 .. 2001:4ca0:2001:13:216:3eff:fe30:d8c6}∪ 2001:4ca0:2001:13:216:3eff:fec7:6d64 ∪ 2001:4ca0:2001:13:216:3eff:fece:fe68 ∪ 2001:4ca0:2001:13:216:3eff:fee1:6973 ∪ {2001:4ca0:2001:13:216:3eff:fe30:d8c8 .. 2001:4ca0:2001:13:216:3eff:fe32:c968}∪{2001:4ca0:2001:13:216:3eff:fe32:c96b .. 2001:4ca0:2001:13:216:3eff:fee9:36a6 ∪ 2001:4ca0:2001:13:216:3eff:fee9:a554 ∪ 2001:4ca0:2001:13:216:3eff:feea:2fb7 ∪ 2001:4ca0:2001:13:216:3eff:fe39:a31e}∪{2001:4ca0:2001:13:216:3eff:fe39:a320 .. 2001:4ca0:2001:13:216:3eff:fe45:41}∪ 2001:4ca0:2001:13:216:3eff:fefe:ce2e ∪ 2001:4ca0:2001:13:219:b9ff:feea:4ce0 ∪ 2001:4ca0:2001:13:219:b9ff:feea:4ce2 ∪ {2001:4ca0:2001:13:216:3eff:fe45:43 .. 2001:4ca0:2001:13:216:3eff:fe50:e76a}∪{2001:4ca0:2001:13:216:3eff:fe50:e76c .. 2001:4ca0:2001:13:250:56ff:fe9d:955 ∪ 2001:4ca0:2001:13:be5f:f4ff:fe4a:497f ∪ 2001:4ca0:2001:14:216:3eff:fe52:ed14 ∪ 2001:4ca0:2001:13:216:3eff:fe5b:5e86}∪{2001:4ca0:2001:13:216:3eff:fe5b:5e88 .. 2001:4ca0:2001:13:216:3eff:fe5f:b83e}∪ 2001:4ca0:2001:14:216:3eff:feff:d683 ∪ 2001:4ca0:2001:17:216:3eff:fe75:f85c ∪ 2001:4ca0:2001:18:216:3eff:fef0:3933 ∪ {2001:4ca0:2001:13:216:3eff:fe5f:b840 .. 2001:4ca0:2001:13:216:3eff:fe60:4429}∪{2001:4ca0:2001:13:216:3eff:fe60:442b .. {2001:4ca0:2001:19:: .. 2001:4ca0:2001:19:ffff:ffff:ffff:ffff}∪ 2001:4ca0:2001:21:216:3eff:fec6:7b51 ∪ 2001:4ca0:2001:13:216:3eff:fe6e:ade6}∪{2001:4ca0:2001:13:216:3eff:fe6e:ade8 .. 2001:4ca0:2001:13:216:3eff:fe75:7acc}∪ 2001:4ca0:2001:40:21b:21ff:fe29:a5cd ∪ 2001:4ca0:2001:40:21d:baff:fe5c:9cf3 ∪ 2001:4ca0:2001:40:21f:d0ff:fe46:17df ∪ {2001:4ca0:2001:13:216:3eff:fe75:7ace .. 2001:4ca0:2001:13:216:3eff:fe76:6aad}∪{2001:4ca0:2001:13:216:3eff:fe76:6aaf .. {2001:4ca0:2001:42:: .. 2001:4ca0:2001:42:ffff:ffff:ffff:ffff}∪{2a00:4700:0:2:21b:21ff:fe42:301c .. 2001:4ca0:2001:13:216:3eff:fe96:6bbb}∪{2001:4ca0:2001:13:216:3eff:fe96:6bbd .. 2001:4ca0:2001:13:216:3eff:fea0:37e4}∪ 2a00:4700:0:2:21b:21ff:fe42:301d}∪{2a00:4700:0:2:225:90ff:fe7a:cbc8 .. 2a00:4700:0:2:225:90ff:fe7a:cbc9}∪ {2001:4ca0:2001:13:216:3eff:fea0:37e6 .. 2001:4ca0:2001:13:216:3eff:fea6:878a}∪{2001:4ca0:2001:13:216:3eff:fea6:878c .. 2a00:4700:0:2:2e0:81ff:fe2f:fd9d ∪{2a00:4700:0:2:2e0:81ff:fe2f:fde2 .. 2a00:4700:0:2:2e0:81ff:fe2f:fde3}∪ 2001:4ca0:2001:13:216:3eff:fea7:6ad4}∪{2001:4ca0:2001:13:216:3eff:fea7:6ad6 .. 2001:4ca0:2001:13:216:3eff:fea8:cbf2}∪ {2a00:4700:0:2:2e0:81ff:feb9:3824 .. 2a00:4700:0:2:2e0:81ff:feb9:3825}∪{2a00:4700:0:3:: .. 2a00:4700:0:3:ffff:ffff:ffff:ffff}∪ {2001:4ca0:2001:13:216:3eff:fea8:cbf4 .. 2001:4ca0:2001:13:216:3eff:fead:288b}∪{2001:4ca0:2001:13:216:3eff:fead:288d .. {2a00:4700:0:6:: .. 2a00:4700:0:7:ffff:ffff:ffff:ffff}∪{2a00:4700:0:9:: .. 2a00:4700:0:9:ffff:ffff:ffff:ffff} 2001:4ca0:2001:13:216:3eff:feb0:5c42}∪{2001:4ca0:2001:13:216:3eff:feb0:5c44 .. 2001:4ca0:2001:13:216:3eff:fec2:1263}∪ {2001:4ca0:2001:13:216:3eff:fec2:1265 .. 2001:4ca0:2001:13:216:3eff:fec7:6d63}∪{2001:4ca0:2001:13:216:3eff:fec7:6d65 .. 2001:4ca0:2001:13:216:3eff:fece:fe67}∪{2001:4ca0:2001:13:216:3eff:fece:fe69 .. 2001:4ca0:2001:13:216:3eff:fee1:6972}∪ {2001:4ca0:2001:13:216:3eff:fee1:6974 .. 2001:4ca0:2001:13:216:3eff:fee9:36a5}∪{2001:4ca0:2001:13:216:3eff:fee9:36a7 .. 2001:4ca0:2001:13:216:3eff:fee9:a553}∪{2001:4ca0:2001:13:216:3eff:fee9:a555 .. 2001:4ca0:2001:13:216:3eff:feea:2fb6}∪ {2001:4ca0:2001:13:216:3eff:feea:2fb8 .. 2001:4ca0:2001:13:216:3eff:fefe:ce2d}∪{2001:4ca0:2001:13:216:3eff:fefe:ce2f .. 2001:4ca0:2001:13:219:b9ff:feea:4cdf}∪ 2001:4ca0:2001:13:219:b9ff:feea:4ce1 ∪{2001:4ca0:2001:13:219:b9ff:feea:4ce3 .. 2001:4ca0:2001:13:250:56ff:fe9d:954}∪{2001:4ca0:2001:13:250:56ff:fe9d:956 .. 2001:4ca0:2001:13:2e0:81ff:feb5:afd7}∪ {2001:4ca0:2001:13:2e0:81ff:feb5:afda .. 2001:4ca0:2001:13:2e0:81ff:fee0:f02e .. 2001:4ca0:2001:13:be5f:f4ff:fe4a:497e}∪ {2001:4ca0:2001:13:be5f:f4ff:fe4a:4980 .. 2001:4ca0:2001:14:216:3eff:fe52:ed13}∪{2001:4ca0:2001:14:216:3eff:fe52:ed15 .. 2001:4ca0:2001:17:225:90ff:fe57:1ff8 2001:4ca0:2001:14:216:3eff:feff:d682}∪{2001:4ca0:2001:14:216:3eff:feff:d684 .. 2001:4ca0:2001:15:ffff:ffff:ffff:ffff}∪ {2001:4ca0:2001:17:: .. 2001:4ca0:2001:17::214}∪{2001:4ca0:2001:17::217 .. 2001:4ca0:2001:17:216:3eff:fe75:f85b}∪ {2001:4ca0:2001:17:216:3eff:fe75:f85d .. 2001:4ca0:2001:17:225:90ff:fe57:1ff7}∪{2001:4ca0:2001:17:225:90ff:fe57:1ff9 .. 2001:4ca0:2001:17:225:90ff:fe57:2259}∪{2001:4ca0:2001:17:225:90ff:fe57:225b .. 2001:4ca0:2001:17:225:90ff:fe7a:cbb9}∪ {2001:4ca0:2001:17:225:90ff:fe7a:cbbc .. 2001:4ca0:2001:17:225:90ff:fe7a:cbbd}∪{2001:4ca0:2001:17:225:90ff:fe7a:cbc0 .. 2001:4ca0:2001:18:216:3eff:fef0:3932}∪{2001:4ca0:2001:18:216:3eff:fef0:3934 .. 2001:4ca0:2001:18:ffff:ffff:ffff:ffff}∪ {2001:4ca0:2001:20:: .. 2001:4ca0:2001:21:216:3eff:fec6:7b50}∪{2001:4ca0:2001:21:216:3eff:fec6:7b52 .. 2001:4ca0:2001:21:ffff:ffff:ffff:ffff}∪{2001:4ca0:2001:30:: .. 2001:4ca0:2001:30:ffff:ffff:ffff:ffff}∪{2001:4ca0:2001:40:: .. 2001:4ca0:2001:40:21b:21ff:fe29:a5cc}∪{2001:4ca0:2001:40:21b:21ff:fe29:a5ce .. 2001:4ca0:2001:40:21d:baff:fe5c:9cf2}∪ {ff00:: .. ffff:ffff:ffff:ffff:ffff:ffff:ffff:ffff} {2001:4ca0:2001:40:21d:baff:fe5c:9cf4 .. 2001:4ca0:2001:40:21f:d0ff:fe46:17de}∪{2001:4ca0:2001:40:21f:d0ff:fe46:17e0 .. ::1 2001:4ca0:2001:40:ffff:ffff:ffff:ffff}∪{2a00:4700:0:1:: .. 2a00:4700:0:2:21b:21ff:fe42:301b}∪{2a00:4700:0:2:21b:21ff:fe42:301e .. 2a00:4700:0:2:225:90ff:fe7a:cbc7}∪{2a00:4700:0:2:225:90ff:fe7a:cbca .. 2a00:4700:0:2:2e0:81ff:fe2f:fd9c}∪ {2a00:4700:0:2:2e0:81ff:fe2f:fd9e .. 2a00:4700:0:2:2e0:81ff:fe2f:fde1}∪{2a00:4700:0:2:2e0:81ff:fe2f:fde4 .. 2a00:4700:0:2:2e0:81ff:feb9:3823}∪{2a00:4700:0:2:2e0:81ff:feb9:3826 .. 2a00:4700:0:2:ffff:ffff:ffff:ffff}∪{2a00:4700:0:4:: .. 2a00:4700:0:5:ffff:ffff:ffff:ffff} 2600:3c02::f03c:91ff:fe84:a75 ∪ 2a01:238:4270:b800:a7dc:c448:3f2:3ce3 ∪ 2a01:238:43d7:c300:74c7:3bfe:cceb:ee03 ∪ 2a01:4f8:202:702c::2 {2001:4ca0:2001:13:2e0:81ff:feb5:afd8 .. 2001:4ca0:2001:13:2e0:81ff:feb5:afd9} {2001:4ca0:2001:17::215 .. 2001:4ca0:2001:17::216}∪ 2001:4ca0:2001:17:225:90ff:fe57:225a ∪ {2001:4ca0:2001:17:225:90ff:fe7a:cbba .. 2001:4ca0:2001:17:225:90ff:fe7a:cbbb}∪ {2001:4ca0:2001:17:225:90ff:fe7a:cbbe .. 2001:4ca0:2001:17:225:90ff:fe7a:cbbf} {2001:4ca0:108:42:: .. 2001:4ca0:108:42::4}∪ {2001:4ca0:108:42::a .. 2001:4ca0:108:42::f}∪ {2001:4ca0:108:42::11 .. 2001:4ca0:108:42:ffff:ffff:ffff:ffff} {2001:4ca0:108:42::5 .. 2001:4ca0:108:42::9} ∪ 2001:4ca0:108:42::10 Fig. 11 Lab IPv6 HTTP Service Matrix (2016) Firewall H. This ruleset from 2003 appears to block Kazaa filesharing traffic during working hours. In addition, a rule drops all packets with the string “X-Kazaa-User”. The more per- missive abstraction correctly tells that the firewall may accept all packets for all IPs (if the above conditions do not hold). Hence, the firewall is essentially abstracted to an allow-all ruleset. According to our metric, this information is not useful. However, in this scenario, this information may reveal an error in the ruleset: the firewall explicitly permits certain IP ranges, but the default policy is Accept and includes all these previously explicitly per- mitted ranges. By inspecting the structure of the firewall, we suspect that the default policy should be Drop. This possible misconfiguration was uncovered by the overapproximation. The underapproximation does not understand the string match on “X-Kazaa-User” in the beginning and thus corresponds to the deny-all ruleset. However, a manual inspection of the underapproximation still reveals an interesting error: the ruleset also tries to prevent MAC address spoofing for some hard-coded MAC/IP pairs. However, we could not see any drop rules for spoofed MAC addresses in the underapproximation. Indeed, the ruleset allows non- spoofed packets but forgets to drop the spoofed ones. This firewall demonstrates the worst case for our approximations: one set of accepted packets is the universe, the other is the empty set. But because this ruleset is severely broken, no better approximation would be possible. Nevertheless, the manual inspection of the simplified ruleset helped reveal several errors. This demonstrates that even if the service matrices do not contain any information, the other output of our tool may still contain interesting information. 123 Verified iptables Firewall Analysis and Verification 235 {0.0.0.0..10.13.36.255}∪ {10.13.38.0..10.13.42.127}∪ {10.13.42.192..10.13.42.255}∪ {10.13.43.32..10.13.43.255}∪ 141.76.2.4 {10.13.45.0..141.76.2.3}∪ {141.76.2.5..255.255.254.25}∪ {255.255.255.1..255.255.255.255} {10.13.43.16..10.13.43.31} {10.13.42.128..10.13.42.175}∪ {10.13.42.176..10.13.42.191} {10.13.43.0..10.13.43.15} {10.13.37.0 .. 10.13.37.255}∪{10.13.44.0 .. 10.13.44.255}∪ 255.255.255.0 Fig. 12 Firewall D SSH service matrix with input and output port rewriting Firewall P. This is the ruleset of the main firewall of a medium-sized company. The admin- istrator asked us what their ruleset was doing. They did not reveal their intentions to prevent analysis results skewed towards the expected outcome. We calculated the simplified firewall rules and service matrices. Using the underapproxi- mation, we could also give guarantees about the packets which are definitely allowed by the firewall. The administrator critically inspected the output of our tool. Finally, they confirmed that the firewall was working exactly as intended. This demonstrates: not only finding errors but showing correctness is one of the key strengths of our tool. After the analysis, the administrator revealed their true intentions. They have previously upgraded the system to iptables. Their users (the company’s employees) became aware of that. They received some complaints about connectivity issues and the employees were blaming the firewall. However, the administrator was suspecting that the connectivity issues were triggered by some users who are behaving against the corporate policy, e.g., sharing user accounts. With the help of our analysis, the administrator could reject all accusations about their firewall configuration and follow their initial suspicion about misbehaving employees. A few months later, we received feedback that the firewall was perfect and “users are stupid”. Firewall R. This ruleset was extracted from a Docker host and partly generated by topoS [21]. For remote management, the ruleset allows unconstrained SSH access for all machines, which can be seen by the fact that the SSH service matrix only shows one partition. In contrast, an advanced setup is enforced for HTTP and the HTTP matrix is visualized in Fig. 13.Being able to verify the publicly exposed HTTP setup while neglecting the SSH maintenance setup 123 236 C. Diekmann et al. {0.0.0.0..9.255.255.255}∪ {11.0.0.0..255.255.255.255} {10.0.0.1, 10.0.0.42} {10.0.0.4} {10.0.0.2} {10.0.0.3} {10.0.0.0}∪{10.0.0.5..10.0.0.41}∪ {10.0.0.43..10.255.255.255} Fig. 13 HTTP service matrix with state of a Docker host demonstrates the advantage of calculating our access matrices for each service. We extended fffuu to also show flows which can be in an ESTABLISHED state. This is visualized by an orange dashed line. Due to special, scenario-specific requirements, we can see that 10.0.0.2 is a true information sink and may not even answer to ESTABLISHED connections. The lower closure also exhibits one interesting detail: except for one host which is rate limited, SSH connectivity is guaranteed. Ironically, ITVal segfaults on the original ruleset. With our processing, it terminates successfully but returns a spurious result. 15 Outlook: Verifying OpenFlow Rules OpenFlow [64,67] is a standard for configuring OpenFlow-enabled switches. It is usually referred to in the context of Software-Defined Networking (SDN) and has been hot topic in network management and operations for almost 10 years. This article focused on the analysis of iptables instead of OpenFlow for several reasons: despite OpenFlow 1.0 [67] having been available for over 5 years, it is a relatively young and not very wide-spread product. In contrast, iptables is battle-tested, real-world approved, supports a large amount of features, and has been in productive use for over a decade. There 123 Verified iptables Firewall Analysis and Verification 237 are also decade-old configurations which utilize a vast amount of features, which are no longer fully understood by administrators [3]. As of July 2016, the popular systems and networking Q&A site Server Fault counts more than a hundred times more questions related to iptables than OpenFlow. The related Super User site counts even a thousand times more questions related to iptables than OpenFlow. Over the years, iptables has evolved into a system with an enormous amount of (legacy) features. Compared to this, OpenFlow is a tidy piece of technology. But we anticipate to see similar feature creep over the years, considering, e.g., Nicira extensions [61] or attempts to enhance OpenFlow with generic FPGAs to add “exotic functionality” [12]. In a broader context, by extending OpenFlow or one of its proposed stateful, more feature-rich, successors [7], many iptables features have already been reimplemented on top of it [65]. Our declared goal was to provide scientific methods to understand challenging config- urations (as observed in iptables) and evaluate our methodology on complex, real-world, legacy-grown systems. The insights we obtained can also be applied to OpenFlow. In par- ticular, a large portion of this article focuses on match conditions, e.g., abstracting over unknowns, optimizing, rewriting, normalizing, or even replacing interfaces by IP addresses. Our work on match conditions can be directly reused in future work within the context of OpenFlow. However, iptables is not OpenFlow. In particular, the OpenFlow standard defines a vast amount of actions which can be performed for a packet. In contrast, iptables filtering primarily uses the two actions Accept and Drop. This is because a firewall cleanly separates filtering from other network functions, such as packet rewriting. OpenFlow implementations tend to mix those. We have shown how to deal with unknown match conditions, but unknown actions are an unsolved problem. We discussed what would be required for a full OpenFlow semantics. In particular, a mutable packet model (cf. Sect. 4.2) would be necessary, which our methods do not support. However, there is no technical need for OpenFlow switches to mix packet filtering with other operations. For example, the pipelined OpenFlow Router architecture constructed by Nelson et al. [57, Sect. 3, Fig. 3] clearly separates packet filtering from packet forwarding and rewriting. In general, using pipeline processing as specified in recent OpenFlow standards [64] might be a step forward to separate filtering from forwarding and rewriting. This may also help compilers which produce OpenFlow rules and suffer from a large blow-up which is induced by a cross product over several tables to join rules for different actions into one table [76]. Such a filtering table implemented by OpenFlow rules without unspecified behavior could be analyzed by our presented methods. In contrast to firewall rules, OpenFlow flow table entries are usually not written by hand, but high-level programming languages (such as NetCore [52], NetKAT [4], or Flowlog [56]) can be used. The overall question arises whether the analysis of low-level OpenFlow rules is necessary, since for example a verified compiler from NetCore to OpenFlow exists [33]. Therefore, the analysis and verification of the high-level programming language may be more interesting than the analysis of generated low-level OpenFlow entries. The Flowlog language was especially designed with built-in verification and analysis in mind [55,58] and NetKAT was explicitly designed as a Kleene Algebra with Tests (KAT) which is suitable for formal analysis and it also features an automated decision procedure [30]. https://serverfault.com/. https://superuser.com/. 123 238 C. Diekmann et al. 16 Conclusion This work was motivated by the fact that we could not find any tool which helped us analyze our lab’s and other firewall rulesets. Though much related work about firewall analysis exists, all academic firewall models are too simplistic to be applicable to those real-world rulesets. With the transformations presented in this article, they became processable by existing tools. We have demonstrated the first fully verified, real-world applicable analysis framework for firewall rulesets. Our tool fffuu supports the Linux iptables firewall because it is widely used and well-known for its vast amount of features. It directly works on iptables-save output. We presented an algebra on common match conditions and a method to translate complex conditions to simpler ones. Further match conditions, which are either unknown or cannot be translated, are approximated in a sound fashion. This results in a translation method for complex, real-world rulesets to a simple model. The evaluation demonstrates that, despite possible approximation, the simplified rulesets preserve the interesting aspects of the original ones. Based on the simplified model, we presented algorithms to partition the IPv4 and IPv6 address space and compute service matrices. This allows summarizing and verifying the firewall in a clear manner. The analysis is fully implemented in the Isabelle theorem prover. No additional input or knowledge of mathematics is required by the administrator. The evaluation demonstrates applicability on many real-world rulesets. For this, to the best of our knowledge, we have collected and published the largest collection of real-world iptables rulesets in academia. We demonstrated that our approach can outperform existing tools with regard to correctness, supported match conditions, CPU time, and memory requirements. Our tool helped to verify lack of errors or, alternatively, to discover previously unknown errors in real-world, production rulesets. 17 Availability Our Isabelle/HOL theory files with the formalization and the referenced correctness proofs and our tool fffuu areavailableat https://github.com/diekmann/Iptables_Semantics It is the first fully machine-verified iptables analysis tool. A stable version of the theory files can also be obtained from the “Archive of Formal Proofs” (AFP) [19,22,24,51]. AFP maintenance policy ensures that our formalization will keep working with newer Isabelle releases. The raw data of the analyzed firewall rulesets can be found at https://github.com/diekmann/net-network To the best of our knowledge, this is the largest, publicly-available collection of real-world iptables firewall rulesets. Acknowledgements We thank the anonymous reviewers for suggesting countless improvements to the paper. A special thanks goes to Andreas Korsten for valuable discussions. We thank the network administrators for contributing and agreeing to publish their firewall configurations. Lars Noschinski contributed proofs to the formalization of the IP address space. Manuel Eberl, Lukas Schwaighofer, and Fabian Immler commented on early drafts of this paper. This work was greatly inspired by Tobias Nipkow’s and Gerwin Klein’s book on semantics in Isabelle [62]. 123 Verified iptables Firewall Analysis and Verification 239 Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 Interna- tional License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. References 1. Al-Shaer, E., Alsaleh, M.: ConfigChecker: a tool for comprehensive security configuration analytics. In: Configuration Analytics and Automation (SAFECONFIG), pp. 1–2. IEEE (2011). https://doi.org/10. 1109/SafeConfig.2011.6111667 2. Al-Shaer, E., Hamed, H.: Discovery of policy anomalies in distributed firewalls. In: Annual Joint Confer- ence of the IEEE Computer and Communications Societies (INFOCOM), vol. 4, pp. 2605–2616 (2004). https://doi.org/10.1109/INFCOM.2004.1354680 3. Analyzed firewall rulesets (raw data). https://github.com/diekmann/net-network. Accompanying material 4. Anderson, C.J., Foster, N., Guha, A., Jeannin, J.B., Kozen, D., Schlesinger, C., Walker, D.: NetKAT: semantic foundations for networks. In: 41st ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages, POPL ’14, pp. 113–126. ACM, San Diego (2014). https://doi.org/10.1145/ 2535838.2535862 5. Baker, F., Savola, P.: Ingress filtering for multihomed networks. RFC 3704 (Best Current Practice) (2004) 6. Bartal, Y., Mayer, A., Nissim, K., Wool, A.: Firmato: a novel firewall management toolkit. In: IEEE Symposium on Security and Privacy, pp. 17–31. IEEE (1999). https://doi.org/10.1109/SECPRI.1999. 7. Bianchi, G., Bonola, M., Capone, A., Cascone, C.: OpenState: programming platform-independent stateful openflow applications inside the switch. ACM SIGCOMM Comput. Commun. Rev. 44(2), 44–51 (2014). https://doi.org/10.1145/2602204.2602211 8. Brucker, A.D., Brügger, L., Kearney, P., Wolff, B.: Verified firewall policy transformations for test case generation. In: 3rd International Conference on Software Testing, Verification and Validation, pp. 345– 354. IEEE (2010). https://doi.org/10.1109/ICST.2010.50 9. Brucker, A.D., Brügger, L., Wolff, B.: Model-based firewall conformance testing. In: Suzuki, K., Higashino, T., Ulrich, A., Hasegawa, T. (eds.) Testing of Software and Communicating Systems, pp. 103–118. Springer (2008) 10. Brucker, A.D., Brügger, L., Wolff, B.: Formal firewall conformance testing: an application of test and proof techniques. Softw. Test. Verif. Reliab. (STVR) 25(1), 34–71 (2015). https://doi.org/10.1002/stvr. 1544, https://www.brucker.ch/bibliography/abstract/brucker.ea-formal-fw-testing-2014 11. Brucker, A.D., Brügger, L., Wolff, B.: Formal network models and their application to firewall policies. Archive of Formal Proofs (2017). http://isa-afp.org/entries/UPF_Firewall.shtml. Formal proof develop- ment 12. Byma, S., Tarafdar, N., Xu, T., Bannazadeh, H., Leon-Garcia, A., Chow, P.: Expanding OpenFlow capabilities with virtualized reconfigurable hardware. In: ACM/SIGDA International Symposium on Field-Programmable Gate Arrays, FPGA ’15, pp. 94–97. ACM, Monterey (2015). https://doi.org/10. 1145/2684746.2689086 13. Capretta, V., Stepien, B., Felty, A., Matwin, S.: Formal correctness of conflict detection for firewalls. In: Workshop on Formal Methods in Security Engineering, pp. 22–30. ACM (2007). https://doi.org/10.1145/ 1314436.1314440 14. Cisco IOS firewall—configuring IP access lists. Document ID: 23602 (2007). http://www.cisco.com/c/ en/us/support/docs/security/ios-firewall/23602-confaccesslists.html 15. Cotton, M., Vegoda, L., Bonica, R., Haberman, B.: Special-purpose IP address registries. RFC 6890 (Best Current Practice) (2013) 16. CrazyCat: iptables multiport and negation. Server Fault Question (2016). http://serverfault.com/questions/ 793631/iptables-multiport-and-negation/ 17. Deering, S., Hinden, R.: Internet protocol, version 6 (IPv6) specification. RFC 2460 (Draft Standard) (1998). Updated by RFCs 5095, 5722, 5871, 6437, 6564, 6935, 6946, 7045, 7112 18. Diekmann, C.: Naming network interfaces. In: PoC||GTFO: Pastor Laphroaig Races the Runtime Relinker and Other True Tales of Cleverness and Craft, vol. 16, no. 08, pp. 45–46 (2017) 19. Diekmann, C., Hupel, L.: Iptables semantics. Archive of Formal Proofs (2016). http://isa-afp.org/entries/ Iptables_Semantics.shtml. Formal proof development 20. Diekmann, C., Hupel, L., Carle, G.: Directed security policies: a stateful network implementation. In: Electronic Proceedings in Theoretical Computer Science on Engineering Safety and Security Systems 123 240 C. Diekmann et al. (ESSS), vol. 150, pp. 20–34. Open Publishing Association, Singapore (2014). https://doi.org/10.4204/ EPTCS.150.3 21. Diekmann, C., Korsten, A., Carle, G.: Demonstrating topoS: theorem-prover-based synthesis of secure network configurations. In: 11th International Conference on Network and Service Management (CNSM), pp. 366–371. Barcelona (2015). https://doi.org/10.1109/CNSM.2015.7367384 22. Diekmann, C., Michaelis, J., Haslbeck, M.: Simple firewall. Archive of Formal Proofs (2016). http://isa- afp.org/entries/Simple_Firewall.shtml. Formal proof development 23. Diekmann, C., Michaelis, J., Haslbeck, M., Carle, G.: Verified iptables firewall analysis. In: IFIP Net- working 2016. Vienna (2016) 24. Diekmann, C., Michaelis, J., Hupel, L.: IP addresses. Archive of Formal Proofs (2016). http://isa-afp. org/entries/IP_Addresses.shtml. Formal proof development 25. Diekmann, C., Posselt, S.A., Niedermayer, H., Kinkelin, H., Hanka, O., Carle, G.: Verifying security policies using host attributes. In: Formal Techniques for Distributed Objects, Components, and Systems: 34th IFIP WG 6.1 International Conference, FORTE, pp. 133–148. Springer, Berlin (2014). https://doi. org/10.1007/978-3-662-43613-4_9 26. Diekmann, C., Schwaighofer, L., Carle, G.: Certifying spoofing-protection of firewalls. In: 11th Inter- national Conference on Network and Service Management (CNSM), pp. 168–172. Barcelona (2015). https://doi.org/10.1109/CNSM.2015.7367354 27. diekmann/Iptables_Semantics: Issue #113—Port numbers belong to a specific protocol. github (2016). https://github.com/diekmann/Iptables_Semantics/issues/113 28. Eastep, T.M.: iptables made ease—shorewall (2014). http://shorewall.net/ 29. Engelhardt, J.: Towards the perfect ruleset (2011). http://inai.de/documents/Perfect_Ruleset.pdf 30. Foster, N., Kozen, D., Milano, M., Silva, A., Thompson, L.: A coalgebraic decision procedure for NetKAT. In: 42nd Annual ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages, POPL ’15, pp. 343–355. ACM, Mumbai (2015). https://doi.org/10.1145/2676726.2677011 31. Fuller, V., Li, T.: Classless inter-domain routing (CIDR): the internet address assignment and aggregation plan. RFC 4632 (Best Current Practice) (2006) 32. Gartenmeister, M.: Iptables vs. Cisco PIX (2005). http://lists.netfilter.org/pipermail/netfilter/2005-April/ 059714.html 33. Guha, A., Reitblatt, M., Foster, N.: Machine-verified network controllers. In: 34th ACM SIGPLAN Conference on Programming Language Design and Implementation, PLDI ’13, pp. 483–494. ACM, Seattle (2013). https://doi.org/10.1145/2462156.2462178 34. Haftmann, F., Bulwahn, L.: Code generation from Isabelle/HOL theories (2016) 35. Haftmann, F., Nipkow, T.: Code generation via higher-order rewrite systems. In: Blume, M., Kobayashi, N., Vidal, G. (eds.) Functional and Logic Programming, pp. 103–117. Springer (2010) 36. Hamed, H., Al-Shaer, E.: Taxonomy of conflicts in network security policies. IEEE Commun. Mag. 44(3), 134–141 (2006). https://doi.org/10.1109/MCOM.2006.1607877 37. Hewlett Packard: IP firewall configuration guide (2005). ftp://ftp.hp.com/pub/networking/software/ ProCurve-SR-IP-Firewall-Config-Guide.pdf 38. IPTables Example Config. http://networking.ringofsaturn.com/Unix/iptables.php. Retrieved Sept 2014 39. Jeffrey, A., Samak, T.: Model checking firewall policy configurations. In: Policies for Distributed Systems and Networks, pp. 60–67. IEEE (2009). https://doi.org/10.1109/POLICY.2009.32 40. Kawamura, S., Kawashima, M.: A recommendation for IPv6 address text representation. RFC 5952 (Proposed Standard) (2010) 41. Kazemian, P., Varghese, G., McKeown, N.: Header space analysis: static checking for networks. In: 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI), NSDI’12, pp. 113–126. USENIX Association, San Jose (2012) 42. Kleene, S.C.: Introduction to Metamathematics. Bibliotheca Mathematica. North-Holland, Amsterdam (1952) 43. Lammich, P.: Automatic Data Refinement, pp. 84–99. Springer, Berlin (2013). https://doi.org/10.1007/ 978-3-642-39634-2_9 44. Lammich, P., Tuerk, T.: Applying Data Refinement for Monadic Programs to Hopcroft’s Algorithm, pp. 166–182. Springer, Berlin (2012). https://doi.org/10.1007/978-3-642-32347-8_12 45. Leblond, E.: Why you will love nftables (2014). https://home.regit.org/2014/01/why-you-will-love- nftables/ 46. Linux Kernel Sources: Linux/include/linux/netfilter/x_tables.h. Kernel 4.6. http://lxr.free-electrons.com/ source/include/linux/netfilter/x_tables.h?v=4.6#L343 47. Mansmann, F., Göbel, T., Cheswick, W.: Visual analysis of complex firewall configurations. In: 9th International Symposium on Visualization for Cyber Security, VizSec ’12, pp. 1–8. ACM (2012). https:// doi.org/10.1145/2379690.2379691 123 Verified iptables Firewall Analysis and Verification 241 48. Marmorstein, R.M., Kearns, P.: A tool for automated iptables firewall analysis. In: USENIX Annual Technical Conference, FREENIX Track, pp. 71–81. USENIX Association (2005) 49. Marmorstein, R.M., Kearns, P., et al.: Firewall analysis with policy-based host classification. In: 20th USENIX Large Installation System Administration Conference (LISA), vol. 6. USENIX Association, Washington (2006) 50. Michaelis, J., Diekmann, C.: LOFT—verified migration of Linux firewalls to SDN. Archive of Formal Proofs (2016). http://isa-afp.org/entries/LOFT.shtml. Formal proof development 51. Michaelis, J., Diekmann, C.: Routing. Archive of Formal Proofs (2016). http://isa-afp.org/entries/ Routing.shtml. Formal proof development 52. Monsanto, C., Foster, N., Harrison, R., Walker, D.: A compiler and run-time system for network program- ming languages. In: 39th Annual ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages, POPL ’12, pp. 217–230. ACM (2012) 53. Moy, E., Gildea, S., Dickey, T.: XTerm control sequences (2016). http://invisible-island.net/xterm/ctlseqs/ ctlseqs.html 54. Nelson, T., Barratt, C., Dougherty, D.J., Fisler, K., Krishnamurthi, S.: The Margrave tool for firewall analysis. In: 24th USENIX Large Installation System Administration Conference (LISA). USENIX Asso- ciation, San Jose (2010) 55. Nelson, T., Ferguson, A.D., Krishnamurthi, S.: Static Differential Program Analysis for Software-Defined Networks, pp. 395–413. Springer, Berlin (2015). https://doi.org/10.1007/978-3-319-19249-9_25 56. Nelson, T., Ferguson, A.D., Scheer, M.J., Krishnamurthi, S.: Tierless programming and reasoning for software-defined networks. In: 11th USENIX Symposium on Networked Systems Design and Implemen- tation (NSDI), NSDI’14, pp. 519–531. USENIX Association, Seattle (2014) 57. Nelson, T., Ferguson, A.D., Yu, D., Fonseca, R., Krishnamurthi, S.: Exodus: toward automatic migration of enterprise network configurations to SDNs. In: 1st ACM SIGCOMM Symposium on Software Defined Networking Research, no. 13 in SOSR ’15, pp. 13:1–13:7. ACM, Santa Clara (2015). https://doi.org/10. 1145/2774993.2774997 58. Nelson, T., Guha, A., Dougherty, D.J., Fisler, K., Krishnamurthi, S.: A balance of power: expressive, analyzable controller programming. In: Second ACM SIGCOMM Workshop on Hot Topics in Soft- ware Defined Networking, HotSDN ’13, pp. 79–84. ACM, Hong Kong (2013). https://doi.org/10.1145/ 2491185.2491201 59. NetCitadel, Inc.: FirewallBuilder. http://www.fwbuilder.org.Ver.5.1 60. netfilter coreteam: libxtables/xtables.c. https://git.netfilter.org/iptables/tree/libxtables/xtables.c?h=v1.6. 0#n518 61. Nicira, Inc.: Nicira extensions. openvswitch/ovs repository (2016). https://github.com/openvswitch/ovs/ blob/master/include/openflow/nicira-ext.h. Revision fb8f22c186b89cd36059c37908f940a1aa5e1569 62. Nipkow, T., Klein, G.: Concrete Semantics. Springer, Berlin (2014). https://doi.org/10.1007/978-3-319- 10542-0 63. Nipkow, T., Paulson, L.C., Wenzel, M.: Isabelle/HOL: a proof assistant for higher-order logic. In: LNCS, vol. 2283. Springer (2002, last updated 2016). http://isabelle.in.tum.de/ 64. Nygren, A., Pfaff, B., Lantz, B., Heller, B., Barker, C., Beckmann, C., Cohn, D., Malek, D., Talayco, D., Erickson, D., McDysan, D., Ward, D., Crabbe, E., Schneider, F., Gibb, G., Appenzeller, G., Tourrilhes, J., Tonsing, J., Pettit, J., Yap, K., Poutievski, L., Dunbar, L., Vicisano, L., Casado, M., Takahashi, M., Kobayashi, M., Orr, M., Yadav, N., McKeown, N., dHeureuse, N., Balland, P., Mad- abushi, R., Ramanathan, R., Price, R., Sherwood, R., Das, S., Gandham, S., Curtis, S., Natarajan, S., Mizrahi, T., Yabe, T., Ding, W., Yiakoumis, Y., Moses, Y., Kis, Z.L.: OpenFlow switch speci- fication v1.5.1 (2015). https://www.opennetworking.org/images/stories/downloads/sdn-resources/onf- specifications/openflow/openflow-switch-v1.5.1.pdf.ONFTS-025 65. Petrucci, L., Bonelli, N., Bonola, M., Procissi, G., Cascone, C., Sanvito, D., Pontarelli, S., Bianchi, G., Bifulco, R.: Towards a stateful forwarding abstraction to implement scalable network functions in software and hardware. ArXiv e-prints (2016) 66. PF: the OpenBSD packet filter. http://www.openbsd.org/faq/pf/ 67. Pfaff, B., Heller, B., Talayco, D., Erickson, D., Gibb, G., Appenzeller, G., Tourrilhes, J., Pettit, J., Yap, K., Casado, M., Kobayashi, M., McKeown, N., Balland, P., Price, R., Sherwood, R., Yiakoumis, Y.: OpenFlow switch specification v1.0.0 (2009). http://archive.openflow.org/documents/openflow-spec-v1.0.0.pdf 68. Postel, J.: Internet protocol. RFC 791 (INTERNET STANDARD) (1981). Updated by RFCs 1349, 2474, 69. Pozo, S., Ceballos, R., Gasca, R.M.: CSP-based firewall rule set diagnosis using security policies. In: 2nd International Conference on Availability, Reliability and Security (ARES), pp. 723–729. IEEE, Los Alamitos (2007). https://doi.org/10.1109/ARES.2007.63 123 242 C. Diekmann et al. 70. Pozo, S., Ceballos, R., Gasca, R.M.: Model-based development of firewall rule sets: diagnosing model inconsistencies. Inf. Softw. Technol. 51(5), 894–915 (2009) 71. Renard, B.: cisco-acl-to-iptables (2013). http://git.zionetrix.net/?a=summary&p=cisco-acl-to-iptables. Retrieved Sept 2014 72. Reynolds, J.: Assigned numbers: RFC 1700 is replaced by an on-line database. RFC 3232 (Informational) (2002) 73. Reynolds, J., Postel, J.: Assigned numbers. RFC 1700 (Historic) (1994). Obsoleted by RFC 3232 74. Sherry, J., Hasan, S., Scott, C., Krishnamurthy, A., Ratnasamy, S., Sekar, V.: Making middleboxes someone elses problem: network processing as a cloud service. ACM SIGCOMM Comput. Commun. Rev. 42(4), 13–24 (2012) 75. Sluizer, S., Postel, J.: Mail transfer protocol. RFC 780 (1981). Obsoleted by RFC 788 76. Smolka, S., Eliopoulos, S.A., Foster, N., Guha, A.: A fast compiler for NetKAT. In: International Confer- ence on Functional Programming (ICFP), pp. 328–341. ACM (2015). https://doi.org/10.1145/2784731. 77. Tantau, T., Feuersaenger, C.: The TikZ and pgf packages (2016). Pgfversion 3.0.1a 78. The netfilter.org project: netfilter/iptables project. http://www.netfilter.org/ 79. The netfilter.org project: netfilter/nftables project. http://www.netfilter.org/ 80. Tongaonkar, A., Inamdar, N., Sekar, R.: Inferring higher level policies from firewall rules. In: 21st USENIX Large Installation System Administration Conference (LISA), vol. 7, pp. 1–10. USENIX Association, Dallas (2007) 81. Verizon Business RISK Team, United States Secret Service: 2010 Data Breach Investigations Report (2010). http://www.verizonenterprise.com/resources/reports/rp_2010-DBIR-combined-reports_en_xg. pdf 82. Wool, A.: A quantitative study of firewall configuration errors. IEEE Comput. 37(6), 62–67 (2004) 83. Wool, A.: The use and usability of direction-based filtering in firewalls. Comput. Secur. 23(6), 459–468 (2004) 84. Wool, A.: Trends in firewall configuration errors: measuring the holes in swiss cheese. IEEE Internet Comput. 14(4), 58–65 (2010). https://doi.org/10.1109/MIC.2010.29 85. Yuan, L., Chen, H., Mai, J., Chuah, C.N., Su, Z., Mohapatra, P.: FIREMAN: a toolkit for firewall modeling and analysis. In: IEEE Symposium on Security and Privacy, pp. 199–213 (2006) 86. Zhang, B., Al-Shaer, E., Jagadeesan, R., Riely, J., Pitcher, C.: Specifications of a high-level conflict-free firewall policy language for multi-domain networks. In: 12th ACM Symposium on Access Control Models and Technologies, SACMAT’07, pp. 185–194. ACM (2007). https://doi.org/10.1145/1266840.1266871 87. Zhang, S., Mahmoud, A., Malik, S., Narain, S.: Verification and synthesis of firewalls using SAT and QBF. In: Network Protocols (ICNP), pp. 1–6 (2012). https://doi.org/10.1109/ICNP.2012.6459944 http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Journal of Automated Reasoning Springer Journals

Verified iptables Firewall Analysis and Verification

Free
52 pages

Loading next page...
 
/lp/springer_journal/verified-iptables-firewall-analysis-and-verification-ULJLV9uZhz
Publisher
Springer Journals
Copyright
Copyright © 2018 by The Author(s)
Subject
Computer Science; Mathematical Logic and Formal Languages; Artificial Intelligence (incl. Robotics); Mathematical Logic and Foundations; Symbolic and Algebraic Manipulation
ISSN
0168-7433
eISSN
1573-0670
D.O.I.
10.1007/s10817-017-9445-1
Publisher site
See Article on Publisher Site

Abstract

J Autom Reasoning (2018) 61:191–242 https://doi.org/10.1007/s10817-017-9445-1 Verified iptables Firewall Analysis and Verification 1 1 1 Cornelius Diekmann · Lars Hupel · Julius Michaelis · 1 1 Maximilian Haslbeck · Georg Carle Received: 31 March 2017 / Accepted: 14 December 2017 / Published online: 3 January 2018 © The Author(s) 2018. This article is an open access publication Abstract This article summarizes our efforts around the formally verified static analysis of iptables rulesets using Isabelle/HOL. We build our work around a formal semantics of the behavior of iptables firewalls. This semantics is tailored to the specifics of the filter table and supports arbitrary match expressions, even new ones that may be added in the future. Around that, we organize a set of simplification procedures and their correctness proofs: we include procedures that can unfold calls to user-defined chains, simplify match expressions, and construct approximations removing unknown or unwanted match expressions. For analysis purposes, we describe a simplified model of firewalls that only supports a single list of rules with limited expressiveness. We provide and verify procedures that translate from the complex iptables language into this simple model. Based on that, we implement the verified generation of IP space partitions and minimal service matrices. An evaluation of our work on a large set of real-world firewall rulesets shows that our framework provides interesting results in many situations, and can both help and out-compete other static analysis frameworks found in related work. This work has been supported by the European Commission, project SafeCloud, Grant 653884; German Federal Ministry of Education and Research (BMBF), EUREKA project SASER, Grant 16BP12304, and SENDATE, Grant 16KIS0472. B Lars Hupel lars.hupel@tum.de Cornelius Diekmann diekmann@net.in.tum.de Julius Michaelis michaeli@in.tum.de Maximilian Haslbeck haslbecm@in.tum.de Georg Carle carle@net.in.tum.de Department of Informatics, Technical University of Munich, Boltzmannstr. 3, Garching bei München, Germany 123 192 C. Diekmann et al. Keywords Computer networks · Firewalls · Isabelle · Netfilter · Iptables · Semantics · Formal verification 1 Introduction Firewalls are a fundamental security mechanism for computer networks. Several firewall solutions, ranging from open source [66,78,79] to commercial [14,37], exist. Operating and managing firewalls is challenging as rulesets are usually written manually. While vulnera- bilities in firewall software itself are comparatively rare, it has been known for over a decade [82] that many firewalls enforce poorly written rulesets. However, the prevalent methodology for configuring firewalls has not changed. Consequently, studies regularly report insufficient quality of firewall rulesets [25,36,47,54,74,81,84–86]. The predominant firewall of Linux is iptables [78]. In general, an iptables ruleset is pro- cessed by the Linux kernel for each packet comparably to a batch program: rules are evaluated sequentially, but the action (sometimes called target) is only applied if the packet matches the criteria of the rule. A list of rules is called a chain. Ultimately, the Linux kernel needs to determine whether to ACCEPT or DROP the packet, hence, those are the common actions. Further possible actions include jumping to other chains and continue processing from there. As an example, we use the firewall rules in Fig. 1, taken from an NAS (network-attached storage) device. The ruleset reads as follows: processing starts at the INPUT chain. In the first rule, all incoming packets are sent directly to the user-defined DOS_PROTECT chain, where some rate limiting is applied. A packet which does not exceed certain limits can make it through this chain without getting DROPped by RETURNing back to the second rule of the INPUT chain. In this second rule, the firewall allows all packets which belong to already ESTABLISHED (or RELATED) connections. This is generally considered good practice. Often, the ESTABLISHED rule accepts most packets and is placed at the beginning of a ruleset for performance reasons. However, it is barely interesting for the actual policy (“who may connect to whom”) enforced by the firewall. The interesting aspect is when a firewall accepts a packet which does not yet belong to an established connection. Once a packet is accepted, further packets for this connection are treated as ESTABLISHED. In the example, Chain INPUT (policy ACCEPT) target prot source destination DOS_PROTECT all 0.0.0.0/0 0.0.0.0/0 ACCEPT all 0.0.0.0/0 0.0.0.0/0 state RELATED,ESTABLISHED DROP tcp 0.0.0.0/0 0.0.0.0/0 tcp dpt:22 DROP tcp 0.0.0.0/0 0.0.0.0/0 multiport dports 21,873,5005,5006,80, ← 548,111,2049,892 DROP udp 0.0.0.0/0 0.0.0.0/0 multiport dports 123,111,2049,892,5353 ACCEPT all 192.168.0.0/16 0.0.0.0/0 DROP all 0.0.0.0/0 0.0.0.0/0 Chain DOS_PROTECT (1 references) target prot source destination RETURN icmp 0.0.0.0/0 0.0.0.0/0 icmptype 8 limit: avg 1/sec burst 5 DROP icmp 0.0.0.0/0 0.0.0.0/0 icmptype 8 RETURN tcp 0.0.0.0/0 0.0.0.0/0 tcp flags:0x17/0x04 limit: avg 1/sec burst 5 DROP tcp 0.0.0.0/0 0.0.0.0/0 tcp flags:0x17/0x04 RETURN tcp 0.0.0.0/0 0.0.0.0/0 tcp flags:0x17/0x02 limit: avg 10000/sec ← burst 100 DROP tcp 0.0.0.0/0 0.0.0.0/0 tcp flags:0x17/0x02 Fig. 1 Linux iptables ruleset of a Synology NAS (network attached storage) device 123 Verified iptables Firewall Analysis and Verification 193 the subsequent rules are the interesting ones which shape the firewall’s connectivity policy. There, some services, identified by their ports, are blocked (and any packets with those destination ports will never create an established connection). Finally, the firewall allows all packets from the local network 192.168.0.0/16 and discards all other packets. Several tools [47–49,54,59,69,80,85] have been developed to ease firewall management and reveal configuration errors. Many tools are not designed for iptables directly, but are based on a generic firewall model. When we tried to analyze real-world iptables firewalls with the publicly available static analysis tools, none of them could handle the rulesets. Even after we simplified the firewall rulesets, we found that tools still fail to analyze our rulesets for the following reasons: – They do not support the vast amount of firewall features, – Their firewall model is too simplistic, – They require the administrator to learn a complex query language which might be more complex than the firewall language itself, – The analysis algorithms do not scale to large firewalls, or – The output of the (unverified) verification tools itself cannot be trusted. To illustrate the problem, we decided to use ITVal [48] because it natively supports iptables, is open source, and supports calls to user-defined chains. However, ITVal’s firewall model is representative of the model used by the majority of tools; therefore, the problems described here also apply to a large class of other tools. Firewall models used in related work are surveyed in Sect. 3.1. We used ITVal to partition the IP space of Fig. 1 into equivalence classes (i.e., ranges with the same access rights) [49]. The expected result is a set of two IP ranges: the local network 192.168.0.0/16 and the “rest”. However, ITVal erroneously only reports one IP range: the universe. Removing the first two rules (in particular the call in the DOS_PROTECT chain) lets ITVal compute the expected result. We identified two concrete issues which prevent tools from “understanding” real-world firewalls. First, calling and returning from custom chains, due to the possibility of complex nested chain calls. Second, more seriously, most tools do not understand the firewall’s match conditions. In the above example, the rate limiting is not understood. An ad-hoc implemen- tation of rate limiting for the respective tool might not be possible, because the underlying algorithm might not be capable of dealing with this special case. Even so, this would not solve the general problem of unknown match conditions. Firewalls, such as iptables, support numerous match conditions and several new ones are added in every release. As of version 1.6.0 (Linux kernel 4.10, early 2017), iptables supports more than 60 match conditions with over 200 individual options. We expect even more match conditions for nftables [79]inthe future since they can be written as simple userspace programs [45]. Therefore, it is virtu- ally impossible to write a tool which understands all possible match conditions. Combined with the fact that in production networks, huge, complex, and legacy firewall rulesets have evolved over time, this poses a particular challenge. Our methodology to tackle this can also be applied to firewalls with simpler semantics, or younger technology with fewer features, e.g., Cisco IOS Access Lists or filtering OpenFlow flow tables (Sect. 15). In this article, we first build a fundamental prerequisite to enable tool-supported analysis of real-world firewalls: we present several steps of semantics-preserving ruleset simplifica- tion, which lead to a ruleset that is “understandable” to subsequent analysis tools: first, we unfold all calls to and returns from user-defined chains. This process is exact and valid for arbitrary match conditions. Afterwards, we process unknown match conditions. For that, we embed a ternary-logic semantics into the firewall’s semantics. Due to ternary logic, all match 123 194 C. Diekmann et al. conditions not understood by subsequent analysis tools can be treated as always yielding an unknown result. In a next step, all unknown conditions can be removed. This introduces an over- and underapproximation ruleset, called upper/lower closure. Guarantees about the original ruleset dropping/allowing a packet can be given by using the respective closure ruleset. To summarize, we provide the following contributions for simplifying iptables rulesets: 1. A formal semantics of iptables packet filtering (Sect. 4) 2. Chain unfolding: transforming a ruleset in the complex chain model to a ruleset in the simple list model (Sect. 5) 3. An embedded semantics with ternary logic, supporting arbitrary match conditions, introducing a lower/upper closure of accepted packets (Sect. 6) 4. Normalization and translation of complex logical expressions to an iptables-compatible format, discovering a meta-logical firewall algebra (Sect. 7) We give a small intermediate evaluation to demonstrate these generic ruleset preprocessing steps (Sect. 8). Afterwards, we use these preprocessing steps to build a fully-verified iptables analysis and verification tool on top. In detail, our further contributions are: 5. A simple firewall model, designed for mathematical beauty and ease of static analysis (Sect. 9) 6. A method to translate real-world firewall rulesets into this simple model (Sect. 10), featuring a series of translation steps to transform, rewrite, and normalize primitive match conditions (Sect. 11) 7. Static and automatic firewall analysis methods, based on the simple model (Sect. 12), featuring – IP address space partitioning – Minimal service matrices 8. Our stand-alone, administrator-friendly tool fffuu (Sect. 13) 9. Evaluation on large real-world data set (Sect. 14) 10. Full formal and machine-verifiable proof of correctness with Isabelle/HOL (Sect. 17) 2 Background: Formal Verification with Isabelle We verified all proofs with Isabelle [63], using its standard Higher-Order Logic (HOL). Isabelle is a proof assistant in the LCF tradition: the system is based on a small and well-established kernel. All higher-level specification and proof tools, e.g., for inductive predicates, functional programs, or proof search, have to go through this kernel. Therefore, the correctness of all obtained results only depends on the correctness of this kernel and the iptables semantics (Fig. 2). The full formalization containing a set of Isabelle theory files is publicly available. An interested reader may consult the detailed (100+ pages) proof document. For brevity, we usually omit proofs in this article, but point the reader with a footnote to the corresponding part of the formalization. Section 17 points the reader to our Isabelle formalization and further accompanying material. Notation. We use pseudo code close to SML and Isabelle. Function application is written without parentheses, e.g., fa denotes function f applied to parameter a.Wewrite :: for prepending a single element to a list, e.g., a :: b :: [c, d]=[a, b, c, d],and ::: for appending lists, e.g., [a, b] ::: [c, d]=[a, b, c, d]. The empty list is written as []. [ fa. a ← l] denotes 123 Verified iptables Firewall Analysis and Verification 195 a list comprehension, i.e., applying f to every element a of list l. [ fx y. x ← l , y ← l ] 1 2 denotes the list comprehension where f is applied to each combination of elements of the lists l and l .For fx y = (x , y), this yields the Cartesian product of l and l . 1 2 1 2 Whenever we refer to specific iptables options or modules, we set them in typewriter font. The iptables options can be looked up in the respective man pages iptables(8) and iptables-extensions(8). 3 Related Work We first survey the common understanding of firewalls in the literature and present specific static firewall analysis tools afterwards. 3.1 Firewall Models Packets are routed through the firewall and the firewall needs to decide whether to allow or deny a packet. The firewall’s ruleset determines its filtering behavior. The firewall inspects its ruleset for each single packet to determine the action to apply to the packet. The ruleset can be viewed as a list of rules; usually it is processed sequentially and the first matching rule is applied. The literature agrees on the definition of a single firewall rule. It consists of a predicate (the match expression) and an action. If the match expression applies to a packet, the action is performed. Usually, a packet is scrutinized by several rules. Zhang et al. [86] specify a com- mon format for packet filtering rules. The action is either “allow” or “deny”, which directly corresponds to the firewall’s filtering decision. The ruleset is processed strictly sequentially, no jumping between chains is possible. Yuan et al. [85] call this the simple list model.ITVal also supports calls to user-defined chains as an action. This allows “jumping” within the ruleset without having a final filtering decision yet. This is called the complex chain model [85]. In general, a packet header is a bitstring which can be matched against [87]. Zhang et al. [86] support matching on the following packet header fields: IP source and destination address, protocol, and port on layer 4. This model is commonly found in the literature [6,9,10,69,85,86]. ITVal extends these match conditions with flags (e.g., TCP SYN)and connection states (INVALID, NEW, ESTABLISHED, RELATED). The state matching is treated as just another match condition. This model is similar to Margrave’s model for IOS [54]. When comparing these features to the simple firewall in Fig. 1, it becomes obvious that none of these tools supports that firewall directly. We are not the first to propose simplifying firewall rulesets to enable subsequent analysis. Brucker et al. [8,10,11] provide algorithms to generate test cases from a firewall policy. A firewall policy in their model is a list of rules on disjoint networks. A rule is a partial function from packets to decisions, e.g., allow or deny. To keep the number of test cases manageable, the firewall ruleset is first simplified while preserving the original behavior. The correctness of Firewalls can be stateful or stateless. Most current firewalls are stateful, which means the firewall remembers and tracks information of previously seen packets, e. g., the TCP connection a packet belongs to and the state of that connection (“conntrack” in iptables parlance). ITVal does not track the state of connections. Match conditions on connection states are treated exactly the same as matches on a packet header. In general, by focusing on rulesets and not firewall implementation, matching on conntrack states is exactly like matching on any other (stateless) condition. However, internally in the firewall, not only the packet header is consulted but also the current connection tables. Note that existing firewall analysis tools also largely ignore state [54]. In our semantics, we also model stateless matching. 123 196 C. Diekmann et al. these transformations is proved with Isabelle/HOL. With regard to low-level firewall features, the instantiation used by Brucker et al. in their evaluation is more limited than the model used by the tools presented above. This is not a limitation since their framework is designed to support different firewall technologies by having a more abstract and generic policy model. Yet, it demonstrates that our tool as a preprocessor to transform low-level iptables rules to a generic firewall model is a useful building block. In general, using our tool as preprocessor can make firewall analysis tools from related work available for iptables. We are not aware of any tool which uses a model fundamentally different than those described here. Our model enhances existing work in that we use ternary logic to support arbitrary match conditions. To analyze a large iptables firewall, the authors of Margrave [54] translated it to basic Cisco IOS access lists [14] by hand. With our simplification, we can automatically remove all features not understood by basic Cisco IOS. This enables translation of any iptables firewall to basic Cisco access lists which is guaranteed to drop no more packets than the original iptables firewall. This opens up all tools available only for Cisco IOS access lists, e.g., Margrave [54] and Header Space Analysis [41]. 3.2 Static Firewall Analysis Tools Popular tools for static firewall analysis include FIREMAN [85], Capretta et al. [13], and the Firewall Policy Advisor [2]. They can use the following features to match on packets: IP addresses, ports, and protocol. However, most real-world firewall rulesets we found in our evaluation use many more features. As can be seen in Fig. 1, among others, iptables supports matching on source IP address, layer 4 port, inbound interface, conntrack state, entries and limits in the recent list. Hence, these tools would not be applicable (without our generic preprocessing) to most firewalls from our evaluation. Most aforementioned tools allow detecting conflicts between rules to uncover configura- tion mistakes. Since our approach rewrites rules to a simpler form and the provenance and relation of the simplified rules to the original ruleset is lost, our approach does not support this. However, we offer service matrices (Sect. 12.2) to provide a general overview of the firewall’s filtering behavior. The work most similar to our static analysis tool, in particular to our IP address space partitioning, is ITVal [48]: it supports a large set of iptables features and can compute an IP address space partition [49]. ITVal, as an academic prototype, only supports IPv4, is not formally verified, and its implementation contains several errors. For example, ITVal produces spurious results if the number of significant bits in IP addresses in CIDR notation [31] is not a multiple of 8. It does not consider logical negations which may occur when RETURNing prematurely from user-defined chains, which leads to wrong interpretation of complement sets. It does not support abstracting over unknown match conditions but simply ignores them, which also leads to spurious results. Anecdotally, we uncovered these corner cases when we tried to prove the correctness of our algorithms and Isabelle was presenting unexpected proof obligations. Without the formal verification, our tool would likely contain similar errors. For rulesets with more than 1000 rules, ITVal requires tens of GBs of memory. We are uncertain whether this is a limitation of its internal data structure or just a simple memory leak. ITVal neither proves the soundness nor the minimality of its IP address range partitioning. Nevertheless, ITVal shows the need for and the use of IP address range partitioning and has demonstrated that its implementation works well on rulesets which do not trigger the Note that the other direction is considered easy [71], because basic Cisco IOS access lists have “no nice features” [32]. Also note that there also are Advanced Access Lists. 123 Verified iptables Firewall Analysis and Verification 197 aforementioned errors. Our tool strongly builds on the ideas of ITVal, but with a different algorithm. Exodus [57] translates existing device configurations to a simpler model, similar to our translation step. It translates router configurations to a high-level SDN controller program, which is implemented on top of OpenFlow. Exodus supports many Cisco IOS features. The translation problem solved by Exodus is comparable to this article’s problem of translating to a simple firewall model: OpenFlow 1.0 only supports a limited set of features (comparable to our simple firewall) whereas IOS supports a wide range of features (comparable to iptables). A complex language is ultimately translated to a simple language, which is the ‘hard’ direction. Since our approach loses the relation of the simplified rules to the original ruleset, our approach cannot point to individual flawed firewall rules, but only provides a complete overview. For example, our tool reduces thousands of firewall rules to the easy-to-understand graphinFig. 8, but the information which initial firewall rules and match conditions are responsible for each edge of the graph is lost. Complementary to our verification tool, and well-suited for debugging and uncovering responsible misbehaving rules, is Margrave [54]. Margrave can be used to query firewalls and to troubleshoot configurations or to show the impact of ruleset edits. Margrave can find scenarios, i.e., it can show concrete packets which violate a security policy. Our framework does not show such information. Margrave’s query language, which a potential user has to learn, is based on first-order logic. All these tools have one limitation in common: they do not understand all iptables match conditions. Our generic ruleset preprocessing algorithms help to make a ruleset accessible for the respective tool. However, our generic algorithms still lose too much information. This is because iptables conditions are also related to each other. For example, the iprange mod- ule allows to write down IP address ranges using a notation more expressive than most tools support. Just removing iprange matches would lose too much information, since tools understand matches on IP address ranges in a simpler format. We need to rewrite iprange expressions to a simpler, semantics-preserving notation of IP addresses, commonly under- stood by tools. This may be non-trivial since one rule with one iprange expression may correspond to several rules with only simple matches on IP addresses. As a more involved example, we saw that most firewall analysis tools do not support matching on interfaces. But given that a firewall implements spoofing protection and the routing tables are known, con- ditions matching on network interfaces can be rewritten to those matching on IP addresses. After an intermediate evaluation (Sect. 8), we present in Sect. 11 algorithms to overcome these issues for the most common match conditions. 4 Semantics of iptables We formalized the semantics of a subset of iptables. The semantics focuses on access control, which is done in the INPUT, OUTUT,and FORWARD chain of the filter table. Thus packet modification (e.g., NAT) is not considered (and also not allowed in these chains). Match conditions, e.g., source 192.168.0.0/24 and protocol TCP, are called primitives. A primitive matcher γ decides whether a packet matches a primitive. Formally, basedonaset X of primitives and a set of packets P, a primitive matcher γ is a binary relation over X and P. The semantics supports arbitrary packet models and match conditions, hence both remain abstract in our definition. In one firewall rule, several primitives can be specified. Their logical connective is con- junction, for example src 192.168.0.0/24 and tcp. Disjunction is omitted because 123 198 C. Diekmann et al. it is neither needed for the formalization nor supported by the iptables user interface; this is consistent with the model by Jeffrey and Samak [39]. Primitives can be combined in an algebra of match expressions M : mexpr = x for x ∈ X |¬ mexpr | mexpr ∧ mexpr | Any The match expression Any matches any packet. For a primitive matcher γ and a match expression m ∈ M ,wewrite match γ mp if a packet p ∈ P matches m, essentially lifting γ to a relation over M and P, with the connectives defined as usual. With completely generic P, X,and γ , the semantics can be considered to have access to an oracle which understands all possible match conditions. Furthermore, we support the following actions, modeled closely after iptables: Accept, Reject, Drop, Log, Empty, Call c for a chain c ,and Return.A rule can be defined as a tuple (m, a) for a match expression m and an action a. A list (or sequence) of rules is called a chain. For example, the beginning of the DOS_PROTECT chain in Fig. 1 is [(icmp ∧ icmptype 8 limit: ..., Return), ... ]. A set of named chains is called a ruleset.Let Γ denote the mapping from chain names to chains. For example, Γ DOS_PROTECT returns the contents of the DOS_PROTECT chain. We assume that Γ is well-formed, that is, if a Call c action occurs in a ruleset, then the chain named c is defined in Γ . This assumption is justified, because the Linux kernel only accepts well-formed rulesets. 4.1 Inductive Definition The semantics of a firewall wrt a given packet p, a background ruleset Γ ,and aprimitive matcher γ can be defined as a relation over the currently active chain and the state before and the state after processing this chain. The semantics is specified in Fig. 2. The judge- ment Γ, γ, p  rs, t ⇒ t states that starting with state t, after processing the chain rs, the resulting state is t . For a packet p, our semantics focuses on firewall filtering decisions. Therefore, only the following three states are necessary: the firewall may allow ( )ordeny ( ) the packet, or it may not have come to a decision yet ( ). We will now discuss the most important rules. Accept If the packet p matches the match expression m, then the firewall with no filtering decision ( ) processes the singleton chain [(m, Accept)] by switching to the allow state. Drop/Reject Both actions deny a packet. The difference lies in whether the firewall generates some informational message, which does not influence filtering. NoMatch If the firewall has not come to a filtering decision yet it can process any non-matching rule without changing its state. Decision As soon as the firewall made a filtering decision, all remaining rules can be skipped. Given determinism (Theorem 2), this means that once decided, the firewall does not change its filtering decision of or . Seq If the firewall has not come to a filtering decision and it processes the chain rs , which results in state t and starting from t processes the chain rs , 1 2 which results in state t , then both chains can be processed sequentially, ending in state t . CallResult If a matching Call to a chain named “c” occurs, the resulting state t is the result of processing the chain Γ c. Formalization: inductive iptables_bigstep [19]. 123 Verified iptables Firewall Analysis and Verification 199 match γm p Accept Skip Γ, γ, p  [],t ⇒ t Γ, γ, p  [(m, Accept)], ⇒ match γm p match γm p Drop   Reject ? ? Γ, γ, p  [(m, Drop)], ⇒ Γ, γ, p  [(m, Reject)], ⇒ ¬ match γm p t = NoMatch Decision ? ? Γ, γ, p  [(m, a)], ⇒ Γ, γ, p  rs,t ⇒ t Γ, γ, p  rs , ⇒tΓ,γ,p  rs ,t ⇒ t 1 2 Seq Γ, γ, p  rs ::: rs , ⇒ t 1 2 match γ m p Γ,γ,p  Γc, ⇒ t CallResult Γ, γ, p  [(m, Call c)], ⇒ t match γm pΓc = rs ::: (m , Return):: rs 1 2 ? ? match γm p Γ,γ,p  rs , ⇒ CallReturn ? ? Γ, γ, p  [(m, Call c)], ⇒ match γm p match γm p Log   Empty ? ? ? ? Γ, γ, p  [(m, Log)], ⇒ Γ, γ, p  [(m, Empty)], ⇒ (for any primitive matcher γ and any well-formed ruleset Γ ) Fig. 2 Big-step semantics for iptables CallReturn Likewise, if processing a prefix rs of the called chain does not lead to a filtering decision and directly afterwards, a matching Return rule occurs, the called chain is processed without result. Log/Empty Neither rule influences the filtering behavior. An Empty rule,i.e., arule without an action, is sometimes used by administrators to have iptables only update its internal state, e.g., updating packet counters. The semantics is carefully designed to not require a call stack. The format of the Call- Return rule is part of this design: if we tried to introduce a rule that allows to process a Return without either processing its matching Call or manipulating some call stack, we would necessarily cause problems with the Seq rule. This is because a separated rule for Return would need to remain in the state, and a later rule from the same chain (where we should already have returned from) could then switch to a decision state. One way of avoiding this problem is to merge the functionality of the Seq and Decision rules into all other rules. After doing so, one can introduce a separate Return rule and additionally remove the initial state, since it would always be . An example set of productions for such an alternate formu- lation is shown in Fig. 3. For the practical implementation of our proofs, this alternative lacks flexibility: since the Seq rule is no longer applicable, we cannot easily separate arguments about lists of rules from arguments about the different action types of rules. We provide this as an equivalent alternative because we hope that can provide additional confidence in the correctness of our semantics: Theorem 1 (Equivalence of the two Semantics) If no call to c occurs in any of the chains of Γ and default-policy is either Accept or Drop,then Formalization: theorem iptables_bigstep_r_eq. 123 200 C. Diekmann et al. match γm p match γm p Accept Return Γ, γ, p  (m, Accept):: rs ⇒ Γ, γ, p  (m, Return):: rs ⇒ match γm p match γm p Drop Reject Γ, γ, p  (m, Drop):: rs ⇒ Γ, γ, p  (m, Reject):: rs ⇒ ¬ match γm p Γ,γ,p  rs ⇒ t Skip NoMatch Γ, γ, p  (m, a):: rs ⇒ t Γ, γ, p  [] ⇒ match γm p Γ,γ,p  Γc ⇒tt ∈ , CallResult Γ, γ, p  (m, Call c):: rs ⇒ t Γ, γ, p  Γc ⇒ Γ, γ, p  rs ⇒ t CallNoResult Γ, γ, p  (m, Call c):: rs ⇒ t Γ, γ, p  rs ⇒ t Γ, γ, p  rs ⇒ t Log Empty Γ, γ, p  (m, Log):: rs ⇒ t Γ, γ, p  (m, Empty):: rs ⇒ t (for any primitive matcher γ and any well-formed ruleset Γ ) Fig. 3 Alternative big-step semantics for iptables Γ, γ, p [(m, Call c) ,(True, default-policy)]⇒ t ←→ Γ, γ, p  [(m, Call c) ,(True, default-policy)], ⇒ t Note that for finite rulesets (i.e., the image/range of Γ is finite), we can always find a c such that no call occurs to it. In practice, we will chose c to be INPUT, FORWARD,or OUTPUT. The Linux kernel rejects rulesets where a user calls these chains directly. 4.2 Model Limitations and Stateful Matchers Our primitive matcher is completely stateless: γ :: (X ⇒ P ⇒ B). However, iptables also allows stateful operations, such as marking a packet, and, later on, matching on the marking. The documentation of iptables distinguishes between match extensions and target exten- sions. Ideally, almost all match extensions can be used as if they were stateless. Anything which performs an action should be implemented as target extension, i.e., action. For exam- ple, marking a packet with CONNMARK is an action. Matching on a CONNMARK marking is a match condition. Our semantics does not support the CONNMARK action. This is not a problem since usually, new CONNMARK markings are not set in the filter table. However, it is possible to match on existing markings. Since our primitive matchers and packets are completely generic, this case can be represented within our semantics: instead of keeping an internal CONNMARK state, an additional “ghost field” must be introduced in the packet model. Since packets are immutable, this field cannot be set by a rule, but the packet must be given to the firewall with the final value of the ghost field already set. Hence, an analysis must be carried out with the correct value in the ghost fields when the packet is given to the filter table. We admit that this model is very unwieldy in general. However, for one of the most used stateful modules of iptables, namely connection state tracking with conntrack 123 Verified iptables Firewall Analysis and Verification 201 and state, this model has been proven to be very convenient. We will elaborate on stateful connection tracking (which can be fully supported by our semantics) in Sect. 11.2. For future work, if we want to consider e.g., the raw or mangle table with its extended set of actions or OpenFlow with its full set of actions, a semantics needs to be designed with a mutable packet model. What if a match extension maintains an internal state and changes its behavior on every invocation? Ideally, due to usability, iptables match extensions should be “purely functional”; however, the recent and connbytes modules exhibit side effects on their internal state. As a consequence, the tautology in Boolean logic “a ∧¬a = False” does not hold if a is a module which updates an internal state and its matching behavior after every invocation. Therefore, one might argue that our iptables model can only be applied to stateless match conditions. If we add some state σ and updated state σ to the match condition, the formula “a ∧¬a ” now correctly represents stateful match conditions. Therefore, it would only σ σ be wrong to perform equality operations on stateful match conditions, but not to model stateful match conditions with a specific fixed state. To additionally convince the reader of the soundness of our approach, it would be possible to adapt the parser to give a unique identifier to every primitive which is not known to be stateless. This identifier represents the internal state of that particular match condition at that particular position in a ruleset. It prevents equality operations between multiple invocations of a stateful match condition. This does not change any of our algorithms. 4.3 Analysis and Use of the Semantics The subsequent sections of this article are all based on these semantics. Whenever we provide a procedure P to operate on chains, we proved that the firewall’s filtering behavior is preserved, formally: Γ, γ, p  P rs, t ⇒ t iff Γ, γ, p  rs, t ⇒ t All our proofs are machine-verified with Isabelle. Therefore, once the reader is convinced of the semantics as specified in Fig. 2, the correctness of all subsequent theorems follows automatically, without any hidden assumptions or limitations. The rules in Fig. 2 are designed such that every rule can be inspected individually. However, considering all of them together, it is not immediately clear whether the result depends on the order of their application to a concrete ruleset and packet. Theorem 2 states that the semantics is deterministic, i.e., only one uniquely defined outcome is possible. Theorem 2 (Determinism) If Γ, γ, p  rs, t ⇒ t and Γ, γ, p  rs, t ⇒ t then t = t Next, we show that the semantics are actually total, i.e., there is always a decision for any packet and ruleset. We assume that the ruleset does not have an infinite loop and that all chains which are called exist in the background ruleset. These conditions are checked by the Linux kernel and can thus safely be assumed. In addition, we assume that only the actions defined in Fig. 2 occur in the ruleset; our parser rejects everything else. Formalization: file Semantics_Stateful.thy [19]. Formalization: theorem iptables_bigstep_deterministic [19]. Formalization: theorem semantics_bigstep_defined [19]. 123 202 C. Diekmann et al. We start any analysis with [(Any, Call start-chain), (Any, default-policy)],where the default policy is either Accept or Drop. This means that existing top-level Return actions fall back to the default policy. This is consistent with iptables behavior. Theorem 3 (Totality) If the caller–callee relation is well-founded (i. e., there are no infinite calling loops), Γ is well-formed (i. e., all chain names that are called are defined), there is no Return on top-level, and all actions are supported by the semantics, then ∃t .Γ,γ, p  rs, t ⇒ t To also assert empirically that we only allow analysis of iptables rulesets which are total according to our semantics, we always check the preconditions of Theorem 3 at runtime when our tool loads a ruleset: first, we can statically verify that Γ is well-formed by verifying that all chain names which are referenced in an action are defined and that no unsupported actions occur. Next, our tool verifies that there are no infinite loops by unfolding the ruleset (Sect. 5) only a finite but sufficiently large number of times and aborts if the ruleset is not in the proper form afterwards. These conditions have only been violated for a negligible fraction of all real-world firewalls we have analyzed. Those used very special iptables actions not supported by our semantics or special hand-crafted firewalls which deliberately violate a property and which are also rejected by the Linux kernel. 5 Custom Chain Unfolding In this section, we present algorithms to convert a ruleset from the complex chain model to the simple list model. The function pr (“process return”) iterates over a chain. If a Return rule is encountered, all subsequent rules are amended by adding the Return rule’s negated match expression as a conjunct. Intuitively, if a Return rule occurs in a chain, all following rules of this chain can only be reached if the Return rule does not match. add-match m rs =[(m ∧ m , a). (m, a) ← rs] pr [] = [] pr ((m, Return) :: rs) = add-match (¬m)(pr rs) pr ((m, a) :: rs) = (m, a) :: pr rs The function pc (“process call”) iterates over a chain, unfolding one level of Call rules. If a Call to the chain c occurs, the chain itself (i.e., Γ c) is inserted instead of the Call. However, Returns in the chain need to be processed and the match expression for the original Call needs to be added to the inserted chain. pc [] = [] pc ((m, Call c) :: rs) = add-match m (pr (Γ c)) ::: pc rs pc ((m, a) :: rs) = (m, a) :: pc rs For example, setting CONNMARK in the filter table where it was not necessary, redirecting packets to userspace with NFQUEUE where we do not know how the userspace application handles them, or specialized loggings such as NFLOG which is technically equivalent to the LOG action and could directly be supported. 123 Verified iptables Firewall Analysis and Verification 203 [(¬ (icmp ∧ icmptype 8 limit: ... ) ∧ icmp ∧ icmptype 8, Drop) , (¬ (icmp ∧ icmptype 8 limit: ... ) ∧¬ (tcp ∧ tcp flags:0x17/0x04 limit: ... ) ∧ tcp ∧ tcp flags:0x17/0x04, Drop),..., (src 192.168.0.0/16, Accept) , ... ] Fig. 4 Unfolded Synology firewall The procedure pc can be applied arbitrarily many times and preserves the semantics. Theorem 4 (pc sound and complete) Γ, γ, p  pc rs, t ⇒ t iff Γ, γ, p  rs, t ⇒ t In each iteration, the algorithm unfolds one level of Calls. The algorithm needs to be applied until the result no longer changes. Note that the syntax and semantics allow non- terminating rulesets. However, the only rulesets that are interesting for analysis are the ones actually accepted by the Linux kernel. Since it rejects rulesets with loops, both our algorithm and the resulting ruleset are guaranteed to terminate. Corollary 1 Every ruleset (with only Accept, Drop, Reject, Log, Empty, Call, Return actions) accepted by the Linux kernel can be unfolded completely while preserving its filtering behavior. Since we have not formally verified the Linux kernel sources, Corollary 1 is not formally proven. It follows from our previous theorems and we have extensively checked it empirically. In addition to unfolding calls, the following transformations applied to any ruleset preserve the semantics: – replacing Reject actions with Drop actions, –removing Empty and Log rules, – simplifying match expressions which contain Any or ¬ Any, – for some given primitive matcher, specific optimizations, e.g., rewriting src 0.0.0.0/0 to Any. Therefore, after unfolding and optimizing, a chain which only contains Accept or Drop actions is left. In the subsequent sections, we require this as a precondition. As an example, recall the firewall in Fig. 1.Its INPUT chain after unfolding and optimizing is listed in Fig. 4. Observe that some of the computed match expressions are beyond the expressiveness of what the iptables command line user interface supports. We will elaborate on this in Sect. 7. 6 Unknown Primitives As we argued earlier, it is infeasible to support all possible primitives of a firewall. Sup- pose a new firewall module is created which provides the ssh_blacklisted and Formalization: theorem unfolding_n_sound_complete [19]. The relevant check is in mark_source_chains,file source/net/ipv4/netfilter/ip_table s.c of the Linux kernel version 4.10. Formalization: theorem iptables_bigstep_rw_Reject [19]. Formalization: theorem iptables_bigstep_rm_LogEmpty [19]. Formalization: theorem unfold_optimize_ruleset_CHAIN [19]. Formalization: theorem unfold_optimize_common_matcher_univ_ruleset_CHAIN [19]. 123 204 C. Diekmann et al. ssh_innocent primitives. The former applies if an IP address has had too many invalid SSH login attempts in the past; the latter is the opposite of the former. Since we invented these primitives, no existing tool will support them. However, a new version of iptables could implement them or they may be provided as third-party kernel modules. Therefore, our rule- set transformations must take unknown primitives into account. To achieve this, we lift the primitive matcher γ to ternary logic, adding Unknown as matching outcome. We embed this new “approximate” semantics into the semantics described in the previous sections. Thus, it becomes easier to construct matchers tailored to the primitives supported by a particular tool. 6.1 Ternary Matching Logical conjunction and negation on ternary values are as in Boolean logic, with these additional rules for Unknown operands (commutative cases omitted): True ∧ Unknown = Unknown False ∧ Unknown = False ¬ Unknown = Unknown These rules correspond to Kleene’s 3-valued logic [42] and are well-suited for firewall semantics. For firewall rules, the first equation states that, if one condition matches, the final result only depends on the other condition. The next equation states that a rule cannot match if one of its conditions does not match. Finally, by negating an unknown value, no additional information can be inferred. The match expression Any always evaluates to True and ¬ Any always evaluates to False for any γ . A match expression may evaluate to Unknown if it contains unknown primitives x ∈ X. We demonstrate the ¬ Unknown = Unknown case by example: the two rulesets [(ssh_blacklisted, Drop)] and (Any, Call c) where Γ c =[(ssh_innocent, Return), (Any, Drop)] have exactly the same filtering behavior. After unfolding, the sec- ond ruleset collapses to [(¬ ssh_innocent, Drop)]. Both the ssh_blacklisted and the ssh_innocent primitives are Unknown to our matcher. Thus, since both rulesets have the same filtering behavior, a packet matching Unknown in the first ruleset should also match ¬ Unknown in the second ruleset. Stateful Matchers in Ternary Logic. In Sect. 4.2, we discussed the problem that some match conditions may maintain an internal state. For a match condition a which updates an internal state, “a ∧¬a = False” may not hold. We argued that for some state σ and σ , stateful match conditions need to be augmented with their internal state. For example “a ∧¬a ”, σ σ which is not a tautology. In our implementation, we immediately embed everything in ternary logic and treat all primitives which are not definitely stateless as “unknown”. This avoids the problem with internal state and yields “a ∧¬a = Unknown”, which correctly describes the behavior since we do not know about a potential internal state of some arbitrary match condition a. 6.2 Closures In the ternary semantics, it may be unknown whether a rule applies to a packet. Therefore, the matching semantics are extended with the notion of “in-doubt”-tactics. A tactic is consulted if the result of a match expression is Unknown. It decides whether a rule should apply or not. We introduce the in-doubt-allow and in-doubt-deny tactics. The first tactic forces a match if the rule’s action is Accept and a mismatch if it is Drop. The second tactic behaves in 123 Verified iptables Firewall Analysis and Verification 205 the opposite manner. Note that an unfolded ruleset is necessary, since no behavior can be specified for Call and Return actions. We denote the exact Boolean semantics with “⇒” and embedded ternary semantics with an arbitrary tactic α with “⇒ ”. In particular, α = allow for in-doubt-allow and α =deny analogously. “⇒”and “⇒ ” are related to the tactics as follows: considering the set of all accepted packets, in-doubt-allow is an overapproximation, whereas in-doubt-deny is an underapprox- imation. In other words, if “⇒” accepts a packet, then “⇒ ” also accepts the packet. allow Thus, from the opposite perspective, the in-doubt-allow tactic can be used to guarantee that a packet is certainly dropped. Likewise, if “⇒” denies a packet, then “⇒ ” also denies deny this packet. Thus, the in-doubt-deny tactic can be used to guarantee that a packet is certainly accepted. For example, the unfolded firewall of Fig. 1 contains rules which drop a packet if a limit is exceeded. If this rate limiting is not understood by γ,the in-doubt-allow tactic will never apply this rule, while with the in-doubt-deny tactic, it is applied universally. We say that the Boolean and the ternary matchers agree if they return the same result or the ternary matcher returns Unknown. Interpreting this definition, the ternary matcher may always return Unknown and the Boolean matcher serves as an oracle knowing the correct result. Note that we never explicitly specify anything about the Boolean matcher; therefore the model is universally valid, i.e., the proof holds for an arbitrary oracle. If the exact and ternary matcher agree, then the set of all packets allowed by the in-doubt- deny tactic is a subset of the packets allowed by the exact semantics, which in turn is a subset of the packets allowed by the in-doubt-allow tactic. Therefore, we call all packets accepted by ⇒ the lower closure, i.e., the semantics which accepts at most the packets that the deny exact semantics accepts. Likewise, we call all packets accepted by ⇒ the upper closure, allow i.e., the semantics which accepts at least the packets that the exact semantics accepts. Every packet which is not in the upper closure is guaranteed to be dropped by the firewall. Theorem 5 (Lower and upper closure of allowed packets) p.Γ, γ, p  rs, ⇒ deny p.Γ, γ, p  rs, ⇒ p.Γ, γ, p  rs, ⇒ allow The opposite holds for the set of denied packets. For the example in Fig. 1, we computed the closures (without the RELATED,ESTABLISH ED rule, see Sect. 6.4) and a ternary matcher which only understands IP addresses and layer 4 protocols. The lower closure is the empty set since rate limiting could apply to any packet. The upper closure is the set of packets originating from 192.168.0.0/16. The final decision for Call (resp. Return) rules depends on the called (resp. calling) chain. Formalization: theorem FinalAllowClosure [19]. Formalization: theorem FinalDenyClosure [19]. 123 206 C. Diekmann et al. 6.3 Removing Unknown Matches In this section, as a final optimization, we remove all unknown primitives. We call this algorithm pu (“process unknowns”). For this step, the specific ternary matcher and the choice of tactic must be known. In every rule, top-level unknown primitives can be rewritten to Any or ¬ Any. For example, let m be a primitive which is unknown to γ . Then, for in-doubt-allow, (m , Accept) is u u equal to (Any, Accept) and (m , Drop) is equal to (¬ Any, Drop). Similarly, negated unknown primitives and conjunctions of (negated) unknown primitives can be rewritten. Hence, the base cases of pu are straightforward. However, the case of a negated conjunction of match expressions requires some care. The following equation represents the De Morgan rule, specialized to the in-doubt-allow tactic. Any if pu (¬ m , a) = Any Any if pu (¬ m , a) = Any pu (¬ (m ∧ m ), a) = pu (¬ m , a) if pu (¬ m , a) =¬ Any 1 2 2 1 pu (¬ m , a) if pu (¬ m , a) =¬ Any ⎪ 1 2 ¬ (¬ pu (¬ m , a) ∧¬ pu (¬ m , a)) otherwise 1 2 The algorithm explicitly works on ‘Any’ instead of ‘True’, since in this context, Any is the syntactic base case of a match expression M and not a Boolean or ternary value. The ¬ Unknown = Unknown equation is responsible for the complicated nature of the De Morgan rule. Fortunately, we machine-verified all our algorithms. Anecdotally, we initially wrote a seemingly simple (but incorrect) version of pu and everybody agreed that the algorithm looks correct. In the early empirical evaluation, with yet unfinished proofs, we did not observe our bug. Only because of the failed correctness proof did we realize that we introduced an equation that only holds in Boolean logic. Theorem 6 (pu sound and complete) Γ, γ, p  [pu r. r ← rs], t ⇒ t if f Γ, γ, p  rs, t ⇒ t allow allow Theorem 7 Algorithm pu removes all unknown primitive match expressions. An algorithm for the in-doubt-deny tactic (with the same equation for the De Morgan case) can be specified in a similar way. Thus, ⇒ can be treated as if it were defined only on Boolean logic with only known match expressions. As an example, we examine the ruleset of the upper closure of Fig. 1 (without the RELATED, ESTABLISHED rule, see Sect. 6.4) for a ternary matcher which only under- stands IP addresses and layer 4 protocols. The ruleset is simplified to [(src 192.168.0.0/16, Accept), (Any, Drop)]. ITVal can now directly compute the correct results on this ruleset. 6.4 The RELATED, ESTABLISHED Rule Since firewalls process rules sequentially, the first rule has no dependency on any previous rules. Similarly, rules at the beginning have few dependencies on other rules. Therefore, Formalization: theorems transform_remove_unknowns_upper, transform_remove_unkno wns_lower [19]. 123 Verified iptables Firewall Analysis and Verification 207 firewall rules in the beginning can be inspected manually, whereas the complexity of manual inspection increases with every additional preceding rule. It is good practice to start a firewall with an ESTABLISHED (and sometimes RELATED) rule [29]. This also happens in Fig. 1 after the rate limiting. The ESTABLISHED rule usually matches most of the packets [29], which is important for performance; however, when analyzing the filtering behavior of a firewall, it is important to consider how a connection can be brought to this state. Therefore, we remove this rule and only focus on the connection setup. The ESTABLISHED rule essentially allows packet flows in the opposite direction of all subsequent rules [20]. Unless there are special security requirements (which is not the case in any of our analyzed scenarios), the ESTABLISHED rule can be excluded when analyzing the connection setup [20, Corollary 1]. If the ESTABLISHED rule is removed and in the subsequent rules, for example, a primitive state NEW occurs, our ternary matcher returns Unknown. The closure procedures handle these cases automatically, without the need for any additional knowledge. Our generic ruleset rewriting algorithms are not aware of connection state. Therefore, for our intermediate evaluation (Sect. 8), we removed ESTABLISHED rules by hand. In Sect. 11.2, we will describe our improvements which will enable support for conntrack state. There will no longer be any need to manually exclude rules. In short, we will fully support matches on conntrack state such as ESTABLISHED or NEW. The observation and argument of this section remains: for access control analysis, we focus on NEW packets. 7 Normalization Ruleset unfolding may result in non-atomic match expressions like ¬ (a ∧ b). The iptables user interface only supports match expressions in Negation Normal Form (NNF). There, a negation may only occur before a primitive, not before compound expressions. For example, ¬ ( src ip) ∧ tcp is a valid NNF formula, whereas ¬ (( src ip) ∧ tcp) is not. The reason is that iptables rules are usually specified on the command line and each primitive is an argument to the iptables command, for example ! –src ip -p tcp .Wenormalize match expressions to NNF, using the following observations: De Morgan’s rule can be applied to match expressions, splitting one rule into two. For example, (¬ ( src ip ∧ tcp ), Accept) and [(¬ src ip, Accept), (¬ tcp , Accept)] are equivalent. This introduces a “meta-logical” disjunction consist- ing of a sequence of consecutive rules with a shared action. For example, [(m , a), (m , a)] 1 2 is equivalent to [(m ∨ m , a)]. 1 2 For sequences of rules with the same action, a distributive law akin to common Boolean logic holds. For example, the conjunction of the two rulesets [(m , a), (m , a)] and [(m , a), (m , a)] 1 2 3 4 We revalidated this observation in September 2014 and found that in our firewall, which has seen more than 15 billion packets (>19TB data) since the last reboot, more than 95% of all packets matched the first RELATED,ESTABLISHED rule. The same can be concluded for reflexive ACLs in Cisco’s IOS Firewall [14]. Since match expressions do not contain disjunctions, any match expression in NNF is trivially also in Disjunctive Normal Form (DNF). 123 208 C. Diekmann et al. is equivalent to the ruleset [(m ∧ m , a), (m ∧ m , a), (m ∧ m , a), (m ∧ m , a)]. 1 3 1 4 2 3 2 4 This can be illustrated with a situation where a = Accept and a packet needs to pass two firewalls in a row. We can now construct a procedure which converts a rule with a complex match expression to a sequence of rules with match expressions in NNF. It is independent of the particular primitive matcher and the in-doubt tactic used. The algorithm n (“normalize”) of type M ⇒ M list is defined as follows: nAny =[Any] n (m ∧ m ) =[x ∧ y. x ← n m , y ← n m ] 1 2 1 2 n (¬ (m ∧ m )) = n (¬m ) ::: n (¬m ) 1 2 1 2 n (¬¬m) = n m n (¬ Any) =[] n x =[x ] for x ∈ X n (¬x ) =[¬x ] The second equation corresponds to the distributive law, the third to the De Morgan rule. For example, n (¬ ( src ip ∧ tcp )) = ¬ src ip, ¬ tcp . The fifth rule states that non-matching rules can be removed completely. The unfolded ruleset of Fig. 4, which consists of nine rules, can be normalized to a ruleset of 20 rules (due to distributivity). In the worst case, normalization can cause an exponential blowup. Our evaluation shows that this is not a problem in practice, even for large rulesets. This is because rulesets are usually managed manually, which naturally limits their complexity to a level processible by state-of-the-art hardware. Theorem 8 n always terminates, all match expressions in the returned list are in NNF, and their conjunction is equivalent to the original expression. We show soundness and completeness wrt arbitrary γ , α, and primitives. Hence, it also holds for the Boolean semantics. In general, proofs about the ternary semantics are stronger, because the ternary primitive matcher can simulate the Boolean matcher. Theorem 9 (n sound and complete) Γ, γ, p  [(m , a). m ← n m], t ⇒ t iff Γ, γ, p  [(m, a)], t ⇒ t α α After having been normalized by n, the rules can mostly be fed back to iptables. For some specific primitives, iptables imposes additional restrictions, e.g., that at most one primitive of a type may be present in a single rule. For our intermediate evaluation, we only need to solve this issue for IP address ranges in CIDR notation [31]. We introduced and verified another transformation which computes intersection of IP address ranges, which returns at most one range. This is sufficient to process all rulesets we encountered during our intermediate eval- uation. In the following sections, we show how to support more primitives; the intermediate evaluation only focuses on IP addresses; the final evaluation (Sect. 14) incorporates many more primitives. Formalization: theorem normalized_nnf_match_normalize_match [19]. Formalization: theorem normalize_match_correct [19]. Formalization: theorems β _approximating_bigstep_fun_iff_iptables_bigstep, magic LukassLemma [19]. 123 Verified iptables Firewall Analysis and Verification 209 8 Intermediate Evaluation In this section, we demonstrate the applicability of our ruleset preprocessing described thus far. Usually, network administrators are not inclined towards publishing their firewall ruleset because of potential negative security implications. For this intermediate evaluation, we have obtained approximately 20k real-world rules and the permission to publish them (Sect. 17). An even larger evaluation follows in Sect. 14. In addition to the running example in Fig. 1 (a small real-world firewall), we tested our algorithms on four other real-world firewalls. We put focus on the third ruleset, because it is one of the largest and the most interesting one. For our analysis, we wanted to know how the firewall partitions the IPv4 space. Therefore, we used a matcher γ which only understands source/destination IP addresses and the layer 4 protocols TCP and UDP. Our algorithms do not require special processing capabilities, they can be executed within seconds on a common off-the-shelf laptop with 4GB of memory. Ruleset 1 is taken from a Shorewall [28] firewall, running on a home router, with around 500 rules. We verified that our algorithms correctly unfolds, preprocesses, and simplifies this ruleset. We expected to see, in both the upper and lower closure, that the firewall drops packets from private IP ranges. However, we could not see this in the upper closure and verified that the firewall does indeed not block such packets if their connection is in a certain state. The administrator of the firewall confirmed this issue and, upon further investigation, rewrote the whole firewall. Ruleset 2 is taken from a small firewall script found online [38]. Although it only contains about 50 rules, we found that it contains a serious mistake. We assume the author accidentally confused iptables’ -I (insert at top) and -A (append at tail) options. We saw this after unfold- ing, as the firewall allows nearly all packets at the beginning. Subsequent rules are shadowed and cannot apply. However, these rules come with a documentation of their intended pur- pose, such as “drop reserved addresses”, which highlights the error. We verified the erroneous behavior by installing the firewall on our systems. Thus, our unfolding algorithm alone can provide valuable insights. Ruleset 3 and 4 are taken from the main firewall of our lab (Chair of Network Architectures and Services). One snapshot was taken 2013 with 2800 rules and one snapshot was taken 2014, containing around 4000 rules. It is obvious that these rulesets have grown historically. About 10 years ago, these two rulesets would have been the largest real-world rulesets ever analyzed in academia [82]. We present the analysis results of the 2013 version of the firewall. Details can be found in the additional material, the beginning of the ruleset is shown in Fig. 5.Weremovedthe first three rules. The first rule was the ESTABLISHED rule, as discussed in Sect. 6.4.Our focus was put on the second rule when we calculated the lower closure: this rule was responsible for the lower closure being the empty set. Upon closer inspection of this rule, we realized that it was ‘dead’, i.e., it can never apply. We confirmed this observation by changing the target to a Log action on the real firewall and could never see a hit of this rule for months. Due to our analysis, this rule could be removed. The third rule performed SSH rate limiting (a Drop rule). We removed this rule because we had a very good understanding of it. Keeping it would not influence correctness of the upper closure, but lead to a smaller lower closure than necessary. 123 210 C. Diekmann et al. -A FORWARD -m state --state RELATED,ESTABLISHED,UNTRACKED -j ACCEPT -A FORWARD -m recent --update --seconds 60 --name DEFAULT --rsource -j LOG_RECENT_DROP -A FORWARD -p tcp -m state --state NEW -m tcp --dport 22 --tcp-flags FIN,SYN,RST,ACK SYN ← -m recent --update --seconds 360 --hitcount 41 --name ratessh --rsource ← -j LOG_RECENT_DROP -A FORWARD -s 127.0.0.0/8 -j LOG_DROP -A FORWARD -s 131.159.14.206/32 -i vlan1011 -p tcp -m multiport --sports 389,636 -j ACCEPT -A FORWARD -s 131.159.14.208/32 -i vlan1011 -p tcp -m multiport --sports 389,636 -j ACCEPT ... -A LOG_DROP -m limit --limit 100/min -j LOG --log-prefix "[IPT_DROP]:" -A LOG_DROP -j DROP -A LOG_RECENT_DROP -m limit --limit 100/min -j LOG --log-prefix "[IPT_RECENT_DROP]:" -A LOG_RECENT_DROP -j DROP Fig. 5 Excerpt (first rules) of the 2013 iptables ruleset of our lab First, we tested the ruleset with the well-maintained Firewall Builder [59]. The original ruleset could not be imported by Firewall Builder due to 22 errors, caused by unknown match expressions. Using the calculated upper closure, Firewall Builder could import this ruleset without any problems. Next, we tested ITVal’s IP space partitioning query [49]. On our original ruleset with 2800 rules, ITVal completed the query with around 3GB of RAM in around 1min. Analyzing ITVal’s debug output, we found that most of the rules were not understood correctly due to unknown primitives. Thus, the results were not reliable. We could verify this as 127.0.0.0/8, obviously dropped by our firewall, was grouped into the same class as the rest of the Internet. In contrast, using the upper and lower closure ruleset, ITVal correctly identifies 127.0.0.0/8 as its own class. We found another interesting result about ITVal: the (optimized) upper closure ruleset only contains around 1000 rules and the lower closure only around 500 rules. Thus, we expected that ITVal could process these rulesets significantly faster. However, the opposite is the case: ITVal requires more than 10 times the resources (both CPU and RAM; we had to move the analysis to a big machine with > 40 GB of memory) to finish the analysis of the closures. We assume that this is due to the fact that ITVal now understands all rules. Yet, Sect. 14 will reveal that ITVal still computes wrong results. Limitations of the Translation. We inspected the simplified rulesets and observed a few limitations of the translation. Those limitations mainly occur because our algorithms work on arbitrary γ . While this an important feature, it also means that we did not consider the peculiarities of specific primitives so far. We said that iptables only accepts match expressions in NNF, but this condition alone is insufficient. In addition to NNF, each primitive must occur at most once in a match expression. For example, iptables does not allow to have two -s primitives which match on source IP addresses in an expression. However, such expressions may occur after unfolding and NNF normalization. For this intermediate evaluation, we solved this problem since we can compress the conjunction of an arbitrary number of matches on IP addresses to a single match on IP addresses: the intersection of IP address ranges in CIDR notation is either the smallest of all ranges, or the empty set (details follow in Sect. 11.1). Similarly, the conjunction of all the same matches on protocols is either the protocol itself, otherwise the match expression cannot apply to any packet and the complete rule can be removed. For example, a rule which matches on both tcp and icmp can be removed as a packet cannot be both. In addition, we see rules with ‘unknown’-parts (before the removal of unknown primitives) which can never match and should be removed. For example, it is impossible for a packet the have only the SYN and only the ACK flags set at the same time. However, without providing knowledge about tcp flags, our generic treatment of unknown match conditions may assume that this match 123 Verified iptables Firewall Analysis and Verification 211 condition may apply and such rules remain after the simplification. Hence, our simplification is still too coarse grained and loses too much information. In addition, as we indicated in Sect. 3.2, primitives may also be related and can be transformed into simpler primitives. We elaborate on the treatment of primitives in the following sections. 9 Simple Firewall Model Now, we present a very simple firewall model. This model was designed to feature nice mathematical properties, but it is too simplistic to mirror the real world. Afterwards, we will compare it to our model for real-world firewalls of Sect. 4. Section 10 will show how rulesets can be translated between these two models. This preprocessing step converts firewall rulesets from the real-world model to the simple model, which greatly simplifies all future static firewall analysis. We will write simple firewall rules as tuple (m, a),where m is a match expression and a is the action the firewall performs if m matches for a packet. The firewall has two possibilities for the filtering decision: it may accept ( ) the packet or deny ( ) the packet. We will also use the intermediate state ( ) in which the firewall did not come to a filtering decision yet. Note that iptables firewalls always have a default policy and the case cannot occur as final decision for the simple firewalls we will construct. The semantics of the simple model is given by a recursive function. The first parameter is the ruleset the firewall iterates over, the second parameter is the packet. simple-fw [] p = simple-fw ((m, Accept) :: rs) p = if smatch mp then else simple-fw rs p simple-fw ((m, Drop) :: rs) p = if smatch mp then else simple-fw rs p A function smatch tests whether a packet p matches the match condition m. The match condition is an 7-tuple, consisting of the following primitives: (in, out, src, dst, protocol, src ports, dst ports) In contrast to iptables, negating matches is not supported. In detail, the following primitives are supported: – In/out interface, including support for the ‘+’ wildcard – Source/destination IP address range in CIDR notation, e.g., 192.168.0.0/24 –Protocol (any, tcp, udp, icmp, or any numeric protocol identifier) – Source/destination interval of ports, e.g., 0:65535 For example, we obtain an empty match (a match that does not apply to any packet) if and only if an end port is greater than the start port. The match which matches any packet is constructed by setting the interfaces to ‘+’, the IP to 0.0.0.0/0, the ports to 0:65535 and the protocol to any. We require that all match conditions are well-formed, i.e., it is only allowed to match on ports (other than the universe 0:65535) if the protocol is tcp, udp, or sctp. Note that this is not the same function as in Sect. 4, because this simple smatch function does not require parameter γ . Roughly speaking, it already has the primitive matcher hard-coded into it. Formalization: theorem empty_match [22]. Formalization: theorem simple_match_any [22]. 123 212 C. Diekmann et al. With this type of match expression, it is possible to implement a function conj which takes two match expressions m and m and returns exactly one match expression being the 1 2 conjunction of both. Theorem 10 (Conjunction of two simple match expressions) smatch m p ∧ smatch m p ←→ smatch (conj m m ) p 1 2 1 2 Computing the conjunction of the individual match expressions for port intervals and single protocols is straightforward. The conjunction of two intervals in CIDR notation is either empty or the smaller of both intervals. The conjunction of two interfaces is either empty if they do not share a common prefix, otherwise it is the longest of both interfaces (non-wildcard interfaces dominate wildcard interfaces). The conj of two well-formed matches is again well-formed. The type of match expressions was carefully designed such that the conjunction of two match expressions is only one match expression. If features were added to the match expres- sion, for example negated interfaces, this property would no longer be guaranteed. Of the features most commonly found in our iptables firewall rulesets [3], we only found that it would further be possible to add TCP flags to the match expression without violating the aforementioned conjunction property. Considering common features of firewalls in general [70], it would probably be possible to enhance the ICMP support of our model. One advantage of simple-fw over the semantics of Fig. 2 is that it is a simple recursive function. In addition, simple-fw is total, i.e., it is guaranteed to terminate. This is not the case for the semantics of Fig. 2, as the assumptions of Theorem 3 show. Hence, the simple firewall makes proofs about the filtering behavior much easier as they can often be done by a list induction over the ruleset. Another advantage is that the smatch function of simple-fw is completely defined and it is no longer required to reason about an arbitrary but fixed function γ . 10 Translation to the Simple Firewall Model The semantics given in Sect. 4 includes a primitive matcher γ that decides whether a certain primitive matches a packet. The model and all algorithms on top of it are proven correct for an arbitrary γ , hence, this model supports all iptables matching features. Obviously, there is no executable code for an arbitrary γ . However, the algorithms to transform rulesets we present are executable. To have a clear semantics of the primitives, we have defined a subset of γ , namely for all primitives supported by the simple firewall and some further primitives, detailed in Sect. 11. We assume that γ behaves as expected on our subset, but it may show arbitrary behavior for all other primitives. We say we agree on γ . For example, γ behaves as expected on IP addresses, but it may show arbitrary behavior for a bfp match. Using our previously described algorithms, we assume that the ruleset is already unfolded and the match expressions are normalized. This leaves a ruleset where only the following actions occur: Accept and Drop. Thus, a large step for translating the real-world model to the simple firewall model is already accomplished. Translating the match expressions for the simple firewall remains. Of course, it is not possible to translate all primitives to the very Formalization: theorem simple_match_and_correct [22]. Formalization: theorem simple_match_and_valid [22]. Formalization: theorems rewrite_Goto_chain_safe, unfold_optimize_common_matcher _univ_ruleset_CHAIN [19]. 123 Verified iptables Firewall Analysis and Verification 213 limited simple-fw model, so we will make use of the pu algorithm when necessary. For the sake of example, we will only consider the overapproximation in the following parts of this article; the underapproximation is analogous and can be found in our formalization. Since firewalls usually accept all packets which belong to an ESTABLISHED connection, the interesting access control rules in a ruleset only apply to NEW packets. We only consider NEW packets, i.e., −−ctstate NEW and −−syn for TCP packets. Our first goal is to translate a ruleset from the real-world model to the simple model. We have proven that the set of new packets accepted by the simple firewall is a superset (overapproximation) of the packets accepted by the real-world model. This is a core contribution and we expand on the translation in the following section. Theorem 11 (Translation to simple firewall model) For γ we agree on p. new p ∧ Γ, γ, p  rs, ⇒ p. new p ∧ simple-fw (translate-oapprox rs) p = Any packet dropped by the translated, overapproximated simple firewall ruleset is guar- anteed to be dropped by the real-world firewall, for arbitrary γ , Γ , rs. Similar guarantees for definitely accepted packets can be given by considering the translated underapproximation. Given the simplicity of the simple-fw model, it is much easier to write algorithms to analyze and verify the translated rulesets. Example. Because this article proceeds to focus more on individual primitives, we will increasingly use the more precise syntax of iptables-save which is also described by the man pages iptables(8) and iptables-extensions(8). We consider a FORWARD chain with a default policy of Drop and a user-defined chain foo. -P FORWARD DROP -A FORWARD -s 10.0.0.0/8 -j foo -A foo ! -s 10.0.0.0/9 -j DROP -A foo -p tcp -j ACCEPT This ruleset, although it only consists of three rules and a default policy, is complicated to analyze. Our translation algorithm translates it to the simple firewall model, where the ruleset becomes remarkably simple. We use ∗ to denote a wildcard: ( ∗ , ∗ , 10.128.0.0/9, ∗ , ∗ , ∗ , ∗ ) Drop ( ∗ , ∗ , 10.0.0.0/8 , ∗ ,tcp, ∗ , ∗ ) Accept ( ∗ , ∗ , ∗ , ∗ , ∗ , ∗ , ∗ ) Drop No over- or underapproximation occurred since all primitives could be translated. Note the 10.128.0.0/9 address range, which is the result of the intersection of 10.0.0.0/8 and the negation of 10.0.0.0/9. Formalization: theorems new_packets_to_simple_firewall_overapproximation, new_packets_to_simple_firewall_underapproximation [19]. 123 214 C. Diekmann et al. 11 Translating Primitives In this section, we present algorithms to transform specific primitives without changing the behavior of the firewall. As a result, the primitive matches on interfaces, IP addresses, protocols, and ports will be normalized such that the translation to the simple-fw is obvious. Since iptables supports over 200 individual options for match conditions, we cannot cover all. For example, we do not support any IPsec ah or esp matches or bpf matches, but we will simply abstract over them using our algorithm pu. However, we support the most common features found in common iptables rulesets. Simple matches, such as -s or -d to match on source or destination IP addresses are already supported by the simple-fw.The iprange or multiport module allow matching on IP addresses and ports, but are more expressible than the simple-fw supports. We translate them without the loss of information, but at the cost of increased ruleset size. Other modules, such as conntrack state or tcp flags cannot be expressed in the simple-fw at all. However, we are sometimes able to rewrite them directly to Any or ¬ Any. We continue by describing the normalization of all common primitives found in iptables rulesets. 11.1 IPv4 Addresses According to Nelson [54], “[m]odeling IP addresses efficiently is challenging.” First, we present a datatype to efficiently perform set operations on intervals of machine words, e.g., 32bit integers. We will use this type for IPv4 addresses, but we have generalized to machine words of arbitrary length, e.g., IPv6 addresses or layer 4 ports. For brevity, we will present our formalization at the example of IPv4. We call our datatype a word interval (wi), and WI start end describes the (inclusive) interval. The Union of two wisisdefined recursively. datatype wi = WI word word | Union wi wi Let set denote the interpretation into mathematical sets, then wi has the following semantics: set (WI start end) ={x | start ≤ x ≤ end} set (Union wi wi ) = set wi ∪ set wi 1 2 1 2 An IP address in CIDR notation or IP addresses specified by e.g., −m iprange can be translated to a single WI value. We have implemented and proven correct the common set operations: ‘∪’, ‘{}’, ‘\’, ‘∩’, ‘⊆’, and ‘=’. These operations are linear in the number of Union constructors. The result is optimized by merging adjacent and overlapping intervals and removing empty intervals. We can also represent ‘UNIV’ (the universe of all IP addresses). Since most rulesets use IP addresses in CIDR notation or intervals in general, the wi datatype has proven to be very efficient. Recall that the intersection of two intervals, constructed from addresses in CIDR notation, is either empty or the smaller of both intervals. The datatype wi is an internal representation and for the simple firewall, the result needs to be represented in CIDR notation. For this direction, one WI may correspond to several CIDR ranges. We describe an algorithm to split off one CIDR range from an arbitrary word interval r. The output is a CIDR range and r , the remainder after splitting off this CIDR All lemmas and results of the following subsections ultimately yield Theorem 11 and are referenced in its proof. Formalization: theorem ipcidr_conjunct_correct [24]. 123 Verified iptables Firewall Analysis and Verification 215 range. split is implemented as follows: let a be the lowest element in r. If this does not exist, then r corresponds to the empty set and the algorithm terminates. Otherwise, we construct the listofCIDRranges [a/0, a/1, ..., a/32]. The first element in the list which is well-formed (i.e., all bits after the network prefix must be zero) and which is a subset of r is the wanted element. Note that this element always exists. It is subtracted from r to obtain r .Toconvert r completely to a list of CIDR ranges, this is applied recursively until it yields no more results. This algorithm is guaranteed to terminate and the resulting list in CIDR notation corresponds to the same set of IP addresses as represented by r. Formally, map set (split r ) = set r. Example. split (WI 10.0.0.0 10.0.0.15) =[10.0.0.0/28] split (WI 10.0.0.1 10.0.0.15) =[10.0.0.1/32, 10.0.0.2/31, 10.0.0.4/30, 10.0.0.8/29] With the help of these functions, arbitrary IP address ranges can be translated to the format required by the simple firewall. The following is applied to matches on source and destination IP addresses: first, the IP match expression is translated to a word interval. If the match on an IP range is negated, we compute UNIV \ wi. All matches in one rule can be joined to a single word interval, using the ∩ operation. The resulting word interval is translated to a set of non-negated CIDR ranges. Using the NNF normalization, at most one match on an IP range in CIDR notation remains. We have proven that this process preserves the firewall’s filtering behavior. We conclude with a simple, artificial worst-case example. The evaluation shows that it does not prevent successful analysis: −m iprange−−src-range 0.0.0.1-255.255. 255.254. Translated to the simple firewall, this one range blows up to 62 ranges in CIDR notation. A similar blowup may occur for negated IP ranges. Note that, while pretty printing IPv4 addresses in dotecimal notation (i.e., <dotnum> ::= <snum> . <snum> . <snum> . <snum> [75]) is simple, pretty print- ing IPv6 addresses is non-trivial [40] and our implementation contains the first formally machine-verified IPv6 pretty printer [24]. 11.2 conntrack State If a packet p is matched against the stateful match condition ESTABLISHED, conntrack looks up p in its state table. When the firewall comes to a filtering decision for p,ifthe packet is not dropped and the state was NEW, the conntrack state table is updated such that the flow of p is now ESTALISHED. Similarly, other conntrack states are handled. We present an alternative model for this behavior: before the firewall starts processing the ruleset for p, the conntrack state table is consulted for the state of the connection of p. This state is added as a (phantom) tag to p. Therefore, ctstate can be modeled as just another header field of p. When processing the ruleset, it is not necessary to inspect the conntrack table but only the virtual state tag of the packet. After processing, the state table is updated accordingly. We have proven that both models are equivalent to each other. The latter model is simpler for analysis purposes since the conntrack state can be considered an ordinary packet field. Formalization: theorem cidr_split_prefix [24]. Formalization: file Semantics_Stateful.thy [19]. This holds because the semantics does not modify a packet during filtering. 123 216 C. Diekmann et al. In Theorem 11, we are only interested in NEW packets. In contrast to our intermediate evaluation (Sect. 8), there is no longer the need to manually exclude ESTABLISHED rules from a ruleset. The alternative model allows us to consider only NEW packets: all state matches can be removed (by being pre-evaluated for an arbitrary NEW packet) from the ruleset without changing the filtering behavior of the firewall. 11.3 Layer 4 Ports Translating singleton ports or intervals of ports to the simple firewall is straightforward. A challenge remains for negated port ranges and the multiport module. However, the word interval type is also applicable to 16bit machine words and solves these challenges. For ports, there is no need to translate an interval back to CIDR notation. In the original paper [23], we made a serious mistake [27] when specifying the semantics of matches on ports. Fortunately, the error only manifests itself in corner cases and did not affect the published evaluation. However, we have seen rulesets in the wild which triggered the bug, hence, it is not purely of academic nature. Since we have proven the correctness of all our algorithms and checked all assumptions, the bug did not exist in the code, but in the model. We describe the problem and its resolution (which has already been implemented) in this section. We defined the datatype of a source port match as follows: datatype src-ports = SrcPorts (16 word × 16 word) This datatype describes a source port match as an interval of 16 bit port numbers. The match semantics for a packet were defined such that the source port of the packet must be in the interval. For example, packet p matches SrcPorts ab if and only if a ≤ p.src-port ≤ b.We defined DstPorts analogously. With these semantics, we can construct a corner case which describes why this model does not correspond to reality. Consider the following firewall: *filter :FORWARD ACCEPT [0:0] :CHAIN - [0:0] -A FORWARD -j CHAIN -A CHAIN -p tcp -m tcp --sport 22 -j RETURN -A CHAIN -p udp -m udp --dport 80 -j RETURN -A CHAIN -j DROP COMMIT The firewall in iptables-save format shows the filter table, which consists of the two chains FORWARD and CHAIN.The FORWARD chain is built-in and has a default policy of Accept here. Starting at the FORWARD chain, any packet which is processed by this firewall is directly sent to the user-defined chain CHAIN first. A packet can only Return if it is a TCP packet with source port 22 or a UDP packet with destination port 80. All other packets are dropped. Hence, this firewall expresses in a complicated way the following policy: “Drop everything which is not tcp source port 22 or udp destination port 80”. This ruleset, though it does not have an obvious use, was artificially constructed to demonstrate our bug. Our tool has “simplified” the ruleset in the following way: As a side note, OpenFlow (technically, the Open vSwitch) defines CIDR-like matching for layer 4 ports. With the small change of converting ports to CIDR-like notation, our simple firewall can be directly converted to OpenFlow and we have the first (almost) fully verified translation of iptables rulesets to SDN [50]. 123 Verified iptables Firewall Analysis and Verification 217 ( ∗ , ∗ , ∗ , ∗ , ∗ , 0 : 21 , 0 : 79 ) Drop ( ∗ , ∗ , ∗ , ∗ , ∗ , 0 : 21 , 81 : 65535) Drop ( ∗ , ∗ , ∗ , ∗ , ∗ , 23 : 65535 , 0 : 79 ) Drop ( ∗ , ∗ , ∗ , ∗ , ∗ , 23 : 65535 , 81 : 65535) Drop ( ∗ , ∗ , ∗ , ∗ , ∗ , ∗ , ∗ ) Accept Given our semantics, the simplification is correct. In reality, this simple firewall is wrong for various reasons. First, it is not well-formed, i.e., it tries to match on ports without specifying a protocol. Second, it has mixed up UDP and TCP ports. The problem lies in our semantics of SrcPorts and DstPorts. Roughly speaking, there is no such a thing as “ports”, but TCP ports, UDP ports, SCTP ports, and many others. We have resolved the issue by including the protocol in the match for a port: datatype src-ports = SrcPorts (8 word)(16 word × 16 word) The 8 word corresponds to the protocol field in IPv4 [68], respectively the Next Header field in IPv6 [17], identifying protocols by their assigned numbers [72,73]. It does not allow a wildcard. The semantics defines that the protocol of a packet must be the same as specified in the datatype and that the source port must be in the interval (as in the first definition). With the corrected semantics, our tool computes the correct and expected result: ( ∗ , ∗ , ∗ , ∗ , udp , ∗ , 0 : 79 ) Drop ( ∗ , ∗ , ∗ , ∗ , udp , ∗ , 81 : 65535) Drop ( ∗ , ∗ , ∗ , ∗ , tcp , 0 : 21 , ∗ ) Drop ( ∗ , ∗ , ∗ , ∗ , tcp , 23 : 65535 , ∗ ) Drop ( ∗ , ∗ , ∗ , ∗ , ∗ , ∗ , ∗ ) Accept The negation of a match on ports is the interesting corner case to which the presented problems can be reduced to. We will illustrate the issue with a simpler example. Assuming we have one rule which tries to accept every packet which is not udp destination port 80. For simplicity, we assume we have one rule as follows: ! (-p udp --dport 80) -j ACCEPT . Semantically, to unfold this negation, the rule matches either everything which is not udp or everything which is udp but not destination port 80. It can be expressed with the following two rules: ! -p udp -j ACCEPT followed by -p udp ! --dport 80 -j ACCEPT . We use this strategy in our tool to unfold the negation of matches on ports. Note the type dependencies which occur: negating one rule that matches on ports yields both a rule which matches on protocols and one rule which matches on ports. This example also shows that any tool which reduces match conditions to a flat bit vector is either flawed (it loses the protocol which belongs to a match on ports) or cannot support complicated negations. This includes tools which reduce firewall analysis to SAT [39]or BDDs [1,85]. It may probably also affect ITVal [48] which relies on multi-way decision diagrams (MDD). This was also the case for our Γ, γ, p  rs, s ⇒ t semantics with the Note that this cannot be expressed directly in one rule with iptables. In the example, we used the semantics of Return to construct a compound negated match expression. 123 218 C. Diekmann et al. flawed γ described here. Our simple firewall model does not allow complicated negations and we have proven that the match conditions are always well-formed, hence, the presented class of errors cannot occur there. 11.4 TCP Flags iptables can match on a set of layer 4 flags. To match on flags, a mask selects the corresponding flags and c declares the flags which must be present. For example, the match --syn is a synonym for mask = SYN, RST, ACK, FIN and c = SYN.For aset f of flags in a packet, matching can be formalized as f ∩ mask = c.If c is not a subset of mask, the expression cannot match; we call this the empty match. We proved that two matches (mask , c ) and 1 1 (mask , c ) are equal if and only if (if c ⊆ mask ∧ c ⊆ mask then c = c ∧ mask = 2 2 1 1 2 2 1 2 1 mask else (¬c ⊆ mask ) ∧ (¬c ⊆ mask )) holds. We also proved that the conjunction 2 1 1 2 2 of two matches is exactly (if c ⊆ mask ∧ c ⊆ mask ∧ mask ∩ mask ∩ c = mask ∩ 1 1 2 2 1 2 1 1 mask ∩c then (mask ∪mask , c ∪c ) else empty). If we assume --syn for a packet, we 2 2 1 2 1 2 can remove all matches which are equal to --syn and add the --syn match as conjunction to all other matches on flags and remove rules with empty matches. Some matches on flags may remain, e.g., URG, which need to be abstracted over later. 11.5 Interfaces The simple firewall model does not support negated interfaces, e.g., ! -i eth+. Therefore, they must be removed. We first motivate the need for abstracting over negated interfaces. For whitelisting scenarios one might argue that the use of negated interfaces constitutes bad practice. This is because new (virtual) interfaces might be added to the system at runtime and a match on negated interfaces might now also include these new interfaces. Therefore, negated interfaces correspond to blacklisting, which is not recommended for most firewalls. However, the main reason why negated interfaces are not supported by our model is of technical nature: let set denote the set of interfaces that match an interface expression. For example, set eth0 ={eth0} and set eth+ is the set of all interfaces that start with the prefix eth.Ifthe matchon eth+ is negated, then it matches all strings in the complement set: UNIV \ (set eth+). The simple firewall model requires that a conjunction of two primitives is again at most one primitive. This can obviously not be achieved with such sets. In addition, working with negated interfaces can cause great confusion. Note that the interface match condition ‘+’ matches any interfaces. Also note that ‘+’ ∈ UNIV \ (set eth+). Here, ‘+’is not a wildcard character but the name of an interface. The confusion introduced by negated interfaces becomes more apparent when one realizes that ‘+’ can occur as both wildcard character and normal character. Therefore, it is not possible to construct an interface match condition which matches exactly on the interface ‘+’, because a ‘+’ at the end of an interface match condition is interpreted as wildcard. While technically, the Linux kernel would allow to match on ‘+’ as a normal character [46], the iptables command does not permit to construct such a match [60]. 11.6 Interaction of Interfaces with IP Ranges Later, in Sect. 12.1, we will compute an IP address space partition. For better understanding, that partition should not be “polluted” with interface information. Therefore, for the partition, we will assume that no matches on interfaces occur in the ruleset. In this section, we describe We strongly discourage the use of “ip link set eth0 name +”[18]. 123 Verified iptables Firewall Analysis and Verification 219 a method to remove both negated and non-negated interfaces while preserving their relation to IP address ranges. Input interfaces are usually assigned an IP range of valid source IPs which are expected to arrive on that interface. Let ipassmt be a mapping from interfaces to an IP address range. This information can be obtained by ip route and ip addr. We will write ipassmt[i ] for the corresponding IP range of interface i. For the following examples, we assume ipassmt =[eth0 →{10.8.0.0/16}] The goal is to rewrite input interfaces with the corresponding source IP range. For example, we would like to replace all occurrences of -i eth0 with -s 10.8.0.0/16. This idea can only be sound if there are no spoofed packets; we only expect packets with a source IP of 10.8.0.0/16 to arrive at eth0. Once we have assured that the firewall blocks spoofed packets, we can assume in a second step that there are no spoofed accepted packets left. By default, the Linux kernel offers reverse path filtering, which blocks spoofed packets automat- ically. In this case we can assume that no spoofed packets occur. In some complex scenarios, reverse path filtering needs to be disabled and spoofed packets should be blocked manually with the help of the firewall ruleset. In previous work [26], we presented an algorithm to verify that a ruleset correctly blocks spoofed packets. This algorithm is integrated in our frame- work, proven sound, works on the same ipassmt, and does not need the simple firewall model (i.e., supports negated interfaces). If some interface i should accept arbitrary IP addresses (essentially not providing spoofing protection), it is possible to set ipassmt[i]= UNIV. Therefore, we can verify spoofing protection according to ipassmt at runtime and afterwards continue with the assumption that no spoofed packets occur. Under the assumption that no spoofed packets occur, we will now present two algorithms to relate an input interface i to ipassmt[i ]. Both approaches are valid for negated and non-negated interfaces. The first approach provides better results but requires stronger assumptions (which can be checked at runtime), whereas the second approach can be applied without further assumptions. First Approach. In general, it is considered bad practice [82,83] to have zone-spanning interfaces. Two interfaces are zone-spanning if they share a common, overlapping IP address range. Mathematically, absence of zone-spanning interfaces means that for any two interfaces in ipassmt, their assigned IP range must be disjoint. Our tool emits a warning if ipassmt contains zone-spanning interfaces. If no zone-spanning interfaces are detected, then all input interfaces can be replaced by their assigned source IP address range. This preserves exactly the behavior of the firewall. In this case, there is an injective mapping between input interfaces and source IPs. Interestingly, our proof does not need the assumption that ipassmt maps to the complete IP universe. Second Approach. Unfortunately, though considered bad practice, we found zone-spanning interfaces in many real-world configurations and hence cannot apply the previous algorithm. First, we proved that correctness of the described rewriting algorithm implies absence of zone-spanning interfaces. This leads to the conclusion that it is impossible to perform rewriting without this assumption. Therefore, we present an algorithm which adds the IP range information to the ruleset (without removing the interface match), thus constraining the match on input interfaces to their IP range. The algorithm computes the following: whenever there is a match on an input interface i, the algorithm looks up the corresponding IP range Formalization: theorem iface_replace_needs_ipassmt_disjoint [19]. 123 220 C. Diekmann et al. of that interface and adds -s ipassmt[i ] to the rule. To prove correctness of this algorithm, no assumption about zone-spanning interfaces is needed, ipassmt may only be defined for a subset of the interfaces, and the range of ipassmt may not cover the complete IP universe. Consequently, there is no need for a user to specify ipassmt, but having it may yield more accurate results. Output Port Rewriting. Our presented approaches for input interface rewriting can be gener- alized to also support output interface (-o) rewriting. The core idea is to replace a match on an output interface by the corresponding IP address range which is determined by the system’s routing table. To do this, we parse the routing table, map it to a relation (which provides a structure which is independent of its order), and compute the inverse of the relation. This ultimately provides a mapping for each interface and its corresponding IP address range. This computed mapping is very similar to the ipassmt. In fact, we found it to be a helpful debugging tool to compare the inverse routing relation to an ipassmt. For convenience, we also provide a function to compute an ipassmt from a routing table. Essentially, computing the inverse routing relation semantically is the same behavior as found in strict reverse path filtering [5]. We have formally proven this observation. Because a routing table may change frequently, even triggered by external malicious routing advertisements, by default, we refrain from output port rewriting in this work. In general, we will not apply it in our evaluation (Sect. 14,Table 1); however, in one case (Sect. 14, Firewall D) we will additionally show how the results improve. 11.7 Abstracting Over Primitives Some primitives cannot be translated to the simple model. Section 6.3 already provides the function pu which removes all unknown match conditions. This leads to an approximation and is the main reason for the ‘⊆’ relation in Theorem 11. We found that we can also rewrite any known primitive at any time to an unknown primitive. This can be used to apply additional knowledge during preprocessing. For example, since we understand flags, we know that the following condition is false, hence rules using it can be removed: --syn ∧ --tcp-flags RST,ACK RST. After this optimization, all remaining flags can be treated as unknowns and abstracted over afterwards. This allows to easily add additional knowledge and optimization strategies for further primitive match conditions without the need to adapt any algorithm which works on the simple firewall model. We proved soundness of this approach: the ‘⊆’ relation in Theorem 11 is preserved. 12 Analyzing Simple Firewall Rulesets In this section, we will show two algorithms that work on rulesets translated to the simple-fw model. 12.1 IP Address Space Partitioning We present an algorithm to partition the full space of IP addresses into equivalence classes. It runs roughly in linear time in the number of rules for real-world rulesets. All IP addresses in the same partition show the same behavior wrt the firewall ruleset. We do Formalization: theorem rpf_strict_correct [51]. 123 Verified iptables Firewall Analysis and Verification 221 Table 1 Summary of evaluation on real-world firewalls Fw Rules Chain (unfolded) Simple rules (no ifaces) Use Parts (ITVal) SS H H T T P Time (ITVal) Time (this) [s] A 2784 FW (2376) 2381 (1920) ✓ 246 (1) 13 9 3 h 172 r a – FW (2376) 2837 (581) ✗ 522 (1) 1 1 9 h 194 A 4113 FW (2922) 3114 (2862) ✓ 334 (2) 11 11 27 h 302 – FW (2922) 3585 (517) ✗ 490 (1) 1 1 8 h 320 A 4814 FW (4403) 3574 (3144) ✓ 364 (2) 9 12 46 h 477 r a – FW (4403) 5123 (1601) ✗ 1574 (1) 1 1 3 h 618 A 4946 FW (4887) 4004 (3570) ✓ 371 (2) 9 12 53 h 578 r a – FW (4887) 5563 (1613) ✗ 1585 (1) 1 1 4 h 820 B 88 FW (40) 110 (106) ✓ 50 (4) 4 2 2 s 3 – FW (40) 183 (75) ✓ 40 (1) 1 1 1 s 2 C 53 FW (30) 29 (12) ✓ 8(1) 1 1 1s 1 – FW (30) 27 (1) ✓ 1(1) 1 1 1s 1 – IN (49) 74 (46) ✓ 38 (1) 1 1 1 s 1 – IN (49) 75 (21) ✓ 6(1) 1 1 1s 1 D 373 FW (2649) 3482 (166) ✓ 43 (1) 1 1 3 s 22 – FW (2649) 16592 (1918) ✗ 67 (1) 1 1 33 min 49 E 31 IN (24) 57 (27) ✓ 4(3) 1 2 1s 10 – IN (24) 61 (45) ✗ 3(1) 1 1 1s 1 F 263 IN (261) 263 (263) ✓ 250 (3) 3 3 2 min 80 – IN (261) 265 (264) ✓ 250 (3) 3 3 3 min 57 G 68 IN (28) 20 (20) ✓ 8(5) 1 2 1s 8 – IN (28) 19 (19) ✗ 8(2) 2 2 1s 1 H 19 FW (20) 10 (10) ✗ 9(1) 1 1 1s 8 – FW (20) 8 (8) ✗ 3(1) 1 1 1s 1 222 C. Diekmann et al. Table 1 continued Fw Rules Chain (unfolded) Simple rules (no ifaces) Use Parts (ITVal) SS H H T T P Time (ITVal) Time (this) [s] I 15 FW (5) 4 (4) ✓ 4(4) 4 4 1s 8 – FW (5) 4 (4) ✓ 4(4) 4 4 1s 1 J 48 FW (12) 5 (5) ✓ 3(2) 2 2 1s 6 – FW (12) 8 (2) ✓ 1(1) 1 1 1s 1 K 21 FW (9) 7 (6) ✓ 3 (1) 1 1 1 s 12 – FW (9) 4 (3) ✓ 2(1) 1 1 1s 1 L 27 IN (16) 19 (19) ✓ 17 (3) 2 2 1 s 1 – IN (16) 18 (18) ✓ 17 (3) 2 2 1 s 1 M 80 IN (92) 64 (16) ✓ 2(2) 1 2 1s 6 – IN (92) 58 (27) ✗ 11 (1) 1 1 1 s 1 N 34 FW (14) 12 (12) ✓ 10 (6) 6 6 2 s 2 – FW (14) 12 (12) ✓ 10 (6) 6 6 2 s 1 O 8 IN (7) 9 (9) ✓ 3(3) 1 2 1s 1 – IN (7) 8 (8) ✓ 3(3) 1 2 1s 1 P 595 IN (15) 8 (8) ✓ 3(2) 2 2 1s 6 – IN (15) 9 (9) ✓ 3(2) 2 2 1s 6 595 FW (66) 64 (64) ✓ 60 (5) 5 4 22 s 6 – FW (66) 63 (63) ✓ 60 (5) 5 4 22 s 7 Q 58 IN (59) 65 (65) ✓ 21 (1) 1 1 2 s 2 – IN (59) 62 (62) ✓ 21 (2) 2 1 2 s 1 R 30 FW (28) 123 (123) ✓ 14 (1) 1 6 1 s 1 – FW (28) 20 (3) ✓ 2(2) 2 1 1s 1 ITVal memory consumption, in order of appearance: 84, 96, 94, 95, 61, 98, 96 and 21 GB Verified iptables Firewall Analysis and Verification 223 not require that the partition is minimal. Therefore, the following would be a valid solution: {{0} , {1} , ..., {255.255.255.255}}. However, we will need the partition as starting point for a further algorithm and a partition of size 2 (in case of IPv4) is too large for this purpose. In the case of IPv6, one address per partition would be infeasible. First, we motivate the idea of the partitioning algorithm with the following observation. For an arbitrary packet p,wewrite p(src → s) to fix the source IP address to s. Lemma 1 Let X be the set of all source IP matches specified in rs, i. e., X is a set of CIDR ranges. Given that we have a set B such that ∀ A ∈ X. B ⊆ A ∨ B ∩ A ={} holds. Then, for s ∈ B and s ∈ B, 1 2 simple-fw rs p(src → s ) = simple-fw rs p(src → s ) 1 2 Reading the lemma backwards, it states that all packets with arbitrary source IPs picked from B are treated equally by the firewall. Therefore, B is a member of an IP address range partition. The condition imposed on B is that for all source CIDR ranges which are matched on in the ruleset (called A in the lemma), B is either a subset of the range or disjoint to it. The lemma shows that this condition is sufficient for B, therefore we will construct an algorithm to compute B. For an arbitrary set X, this condition is purely set-theoretic and we can solve it independently from the firewall theory. For simplicity, we use finite sets and lists interchangeably. The algorithm partitions is structured as follows. The part function computes a single step and takes two parameters. The first parameter is a set S ∈ X, the second parameter TS is a set of sets and corresponds to the remaining set which will be partitioned. In the first call, we set TS to {UNIV}. Then, we repeatedly call part on all elements in X and thread through the results, i.e., partitions = foldr part X {UNIV} The step function part itself is implemented as follows: for a fixed S, part STS recurses over TS and splits the set such that the precondition of Lemma 1 holds. part S ({T }∪ TS) = (S ∩ T ) ∪ (T \ S) ∪ (part (S \ T ) TS) part S {} = {} The result size of calling part once can be up to two times the size of TS. This implies that |rules| the size of the partition of a complete firewall ruleset is in the order of O(2 ).However, the empirical evaluation shows that the resulting size for real-world rulesets is much better. While IP address ranges may overlap in a ruleset, they usually do not overlap in the worst possible way for all pairs of rules. Consequently, at least one of the sets S ∩ T or T \ S is usually empty. For example, for our largest firewall, the number of computed partitions is 10 times smaller than the number of rules. Our evaluation (Table 1 in Sect. 14) confirms that the number of partitions is usually less than the number of rules. Our algorithm fulfills the assumption of Lemma 1 for arbitrary X. Because IP addresses occur as source and destination in a ruleset, we use our partitioning algorithm where X is the set of all IPs found in the ruleset. The result is a partition where for any two IPs in the same partition, setting the source or destination of an arbitrary packet to one of the two IPs, the firewall behaves equally. This results in a stronger version of Lemma 1, which holds 123 224 C. Diekmann et al. without any assumption and also holds for both source and destination IPs simultaneously. In addition, the partition covers the complete IPv4 (or IPv6) address space. 12.2 Service Matrices The computed IP address space partition may not be minimal. This means that two different partitions may exhibit exactly the same behavior. Therefore, for manual firewall verification, these partitionings may be misleading. Marmorstein elaborates on this problem [49]. ITVal’s solution is to minimize the partitioning. We suggest to minimize the partitioning, but wrt a fixed service. The evaluation shows that the result is smaller and thus clearer. A fixed service corresponds to a fixed packet with arbitrary IPs. For example, we can define SSH as TCP, destination port 22, and arbitrary but fixed source port ≥ 1024. A service matrix describes the allowed accesses for a specific service over the complete IPv4 (or IPv6) address space. It can be visualized as a graph; for example, the ruleset of Fig. 6 is visualized in Fig. 7. An example of a service matrix for a firewall with several thousands of rules is showninFig. 8. For clarity, this figure uses symbolic names (e.g., servers) instead of IP addresses. The raw IP addresses can be found in Fig. 9. More complicated examples with highly fragmented IP ranges are shown in Figs. 10 and 11; those stem from the same firewall installation, but at a later time. All matrices are minimal, i.e., they cannot be compressed any further. First, we describe when a firewall exhibits the same behavior for arbitrary source IPs s , s 1 2 and a fixed packet p: ∀d. simple-fw rs p(src → s , dst → d) = simple-fw rs p(src → s , dst → d) 1 2 We say the firewall shows same behavior for a fixed service if, in addition, the analogue condition holds for destination IPs. We present a function groupWIs, which computes the minimal partitioning for a fixed service. The idea is to start with the output of the algorithm partitions and minimize it. For this, the full, square access control matrix for inbound and outbound connections of each partition member is generated. An entry m in this matrix denotes whether partition member i, j i is allowed to communicate with partition member j. In detail, an entry m is a pair of i, j Boolean values, where the first element denotes whether all IP addresses in i are allowed to communicate with all IP addresses in j and the second entry denotes whether all IP addresses in j are allowed to communicate with all IP addresses in i. To compute all the entries m , i, j the algorithm performs two calls (one for source IP and one for destination IP) to simple-fw for each pair of partition members. This can be done by taking arbitrary representatives from each member of the partition as source and destination address and executing simple-fw for the fixed packet with those fixed IPs. The matrix is minimized by merging partitions with equal behavior, i.e., merging equal rows in the matrix. This algorithm is quadratic in the number of partitions. An early evaluation [23] shows that it scales surprisingly well, even for large rulesets, since the number of partitions is usually small. 44 45 46 The algorithm is sound, complete, and generates minimal results. Consequently, groupWIs computes an equivalence relation over IP addresses with respect to a simple Formalization: theorem getParts_samefw [22]. Formalization: theorem getParts_complete [22]. Formalization: theorem build_ip_partition_same_fw [22]. Formalization: theorem build_ip_partition_complete [22]. Formalization: theorem build_ip_partition_same_fw_min [22]. 123 Verified iptables Firewall Analysis and Verification 225 firewall ruleset for a fixed service. Hence, we call the members of the output set of groupWIs equivalence classes. Any IP address is a representative for its equivalence class. Theorem 12 (groupWIs sound and generates minimal results) For any two IPs in any equivalence class of groupWIs, the firewall shows the same behavior for a fixed service. For any two arbitrary equivalence classes A and B in groupWIs, if we can find two IPs in A and B respectively where the firewall shows the same behavior for a fixed service, then A = B. Improving Performance. We assume that the ruleset has a default policy. Otherwise, we fall back to our previous, slower algorithm. Any simplified, well-formed iptables ruleset has a default policy though. The above algorithm performs calls to simple-fw for each pair of representatives in the partition. The algorithm is significantly slowed down by the quadratic number of calls to simple-fw. Instead of repeatedly executing simple-fw for all combinations of representatives as source and destination address, for a fixed service and fixed source address, we can pre-compute the set of all matching destination addresses with one iteration over the ruleset. The same holds for the matching source addresses. As a rough estimate, this brings down the quadratic number of calls to simple-fw to a linear number of iterations over the ruleset. Note that the asymptotic runtime is still quadratic. We have implemented this improved algorithm and proven that Theorems 12 and 13 still hold for it. The empirical evaluation shows that this improvement yields a tenfold speedup. Final Theorem. A service matrix is a square matrix where the number of rows (resp. columns) corresponds to the number of equivalence classes computed by groupWIs.Anentry m i, j in a service matrix should mean that all IP addresses in equivalence class i are allowed to communicate with all IP addresses in equivalence class j. This matrix may not be symmetric and it is not the same as the internal representation used in groupWIs.Sofar,Theorem 12 only gives guarantees about the layout of the matrix (i.e., rows and columns), but it does not guarantee that the content of the matrix (i.e., the permissions m ) has the desired property. i, j In addition, we don’t want to present a matrix, but we want to visualize the allowed accesses as graph, for example as shown in e.g., Figs. 7, 8, 9, 10, 11,or 12. Since a service matrix is a square matrix, it can be visualized as graph by treating it as an adjacency matrix. In this way, the function groupWIs only computes the nodes of the graph. To draw a graph, for example with TikZ [77] or Graphviz, one first needs to print the nodes and print the edges afterwards. The name of the nodes (representatives) should not be printed but the IP range they actually represent (equivalence classes). For example, the source code for Fig. 7 may be defined as follows: \begin{tikzpicture} \node (a) at (-4,-4) {$\{131.159.21.0 .. 131.159.21.255\}$}; \node (b) at (4,-4) {$\{131.159.15.240 .. 131.159.15.255\}$}; \node (c) at (0,-6) {$\{127.0.0.0 .. 127.255.255.255\}$}; ... \draw (a) to (b); \draw (c) to (a); Since we can easily check at runtime whether a ruleset has a default policy, this fallback solely exists for the purpose of stating our theorems without requiring the assumption of a default policy. Our faster algorithm (with default policy) and slower algorithm (without default policy) compute the same result. In practice, any ruleset has a default policy and the faster algorithm is always used. http://www.graphviz.org/. 123 226 C. Diekmann et al. \draw (c) to (b); \draw (c) to (c); ... \end{tikzpicture} In this example, the node names a, b,and c are identifiers which semantically correspond to the set of IP addresses described by their label. For example, a represents the equivalence class with the range from 131.159.21.0 to 131.159.21.255. The coordinates, for example (-4,-4) for node a are not relevant for our concerns. The edges mean that the complete IP ranges referenced by their representatives may communicate, e.g., \draw (a) to (b) means that the complete set 131.159.21.0/24 may establish connections to 131.159.15.240/28. In the final drawing, the identifiers a, b,and c are not shown but only their corresponding IP ranges. Agraph (V , E ) consists of a set of vertices V and a set of edges E ⊆ V × V . In our scenario, we have a map V where the keys are identifiers (a, b, c, …) which map to their equivalence class (set of IP addresses). We chose V to be the domain of V . Conveniently, the ˆ ˆ union of the range of V is the universe. We compute the keys of V by calling groupWIs and selecting a representative for each equivalence class (e.g., by taking the lowest IP address). We compute E by calling simple-fw for each pair of V × V.Notethat V is minimized and the empirical evaluation shows that this quadratic number of calls to simple-fw is not a performance problem. For convenience, we printed symbolic identifiers a, b, c,…forthe keys of V instead of IP addresses. We present a final theorem which justifies the correctness of graphs which are drawn according to our method. Theorem 13 (Service Matrix) Let (V , E ) be a service matrix. Then, ∃ s d s d .(s , d ) ∈ E ∧ repr repr range range repr repr Vs = Some s ∧ s ∈ s ∧ repr range range Vd = Some d ∧ d ∈ d repr range range ←→ simple-fw rs p(src → s, dst → d) = The theorem reads as follows: for a fixed connection, one can look up IP addresses (source s and destination d pairs) in the graph if and only if the firewall accepts this (s, d) IP address pair for the fixed connection. The part which complicates the formalization is the notion of “looking up IP addresses in the graph”. To look up a source IP address s in the graph, one first locates s as a member in one of the IP equivalence classes, here s . This equivalence class is represented by a repre- range sentative s . The same is done to obtain d . The theorem now says that (s , d ) ∈ E repr repr repr repr if and only if the firewall allows packets from s to d. The if-and-only-if relationship in combi- nation with the existential quantifier also implies that there is always exactly one equivalence class in which we can find s and d, which means that our graph always contains a complete and disjoint representation of the IP address space. Formalization: definition access_matrix, theorem access_matrix [22]. 123 Verified iptables Firewall Analysis and Verification 227 *filter :INPUT DROP [0:0] :FORWARD DROP [0:0] :OUTPUT DROP [0:0] :DOS_PROTECT - [0:0] :GOOD~STUFF - [0:0] -A FORWARD -j DOS_PROTECT -A FORWARD -j GOOD~STUFF -A FORWARD -p tcp -m multiport ! --dports 80,443,6667,6697 -m hashlimit ← --hashlimit-above 10/sec --hashlimit-burst 20 --hashlimit-mode srcip ← --hashlimit-name aflood --hashlimit-srcmask 8 -j LOG -A FORWARD ! -i lo -s 127.0.0.0/8 -j DROP -A FORWARD -i internal -s 131.159.21.0/24 -j ACCEPT -A FORWARD -s 131.159.15.240/28 -d 131.159.21.0/24 -j DROP -A FORWARD -p tcp -d 131.159.15.240/28 -j ACCEPT -A FORWARD -i -p tcp -s 131.159.15.240/28 -j ACCEPT -A GOOD~STUFF -i lo -j ACCEPT -A GOOD~STUFF -m state --state ESTABLISHED -j ACCEPT -A GOOD~STUFF -p icmp -m state --state RELATED -j ACCEPT -A DOS_PROTECT -i eth1 -p icmp -m icmp --icmp-type 8 ... --limit 1/sec -j RETURN -A DOS_PROTECT -i eth1 -p icmp -m icmp --icmp-type 8 -j DROP COMMIT Fig. 6 Example ruleset. (Color figure online) 13 Stand-Alone Haskell Tool fffuu We used Isabelle’s code generation features [34,35] to build a stand-alone tool in Haskell. Since all analysis and transformation algorithms are written in Isabelle, we only needed to add parsers and user interface. Overall, more than 80% of the code is generated by Isabelle, which gives us strong trust in the tool. We call our tool fffuu,the “f ancy f ormal f irewall universal understander”. fffuu requires only one parameter to run, namely, an iptables-save dump. This makes it very usable. Optionally, one may pass an ipassmt, change the table or chain which is loaded, pass a routing table for output port rewriting, or select the services for the service matrix. fffuu can be easily compiled from source using stack, which ensures reproducible builds well into the future. Example. We demonstrate fffuu by a small example. We want to infer the intention behind the ruleset shown in Fig. 6. Though this ruleset was artificially crafted to demonstrate certain corner cases, it is based on actual rules from real-world firewalls [3,16]. Also note that the \e[31m \e[0m (rendered as ) interface name with UTF-8 symbols and shell escapes for color [53] is perfectly valid. It is hard to guess what the ruleset is implementing. We load the ruleset into fffuu, not requiring any additional parameters or manual steps to compute it. The resulting service matrix (for arbitrary ports) is shown in Fig. 7 and provides insight into the intention of the ruleset. An arrow from one IP range to another IP range indicates that the first range may set up connections with the second. At the bottom, we see the localhost range of 127.0.0.0/8. The reflexive arrow (localhost to localhost) shows that the firewall does not block its own localhost traffic, which is usually https://docs.haskellstack.org/en/stable/README/. 123 228 C. Diekmann et al. {0.0.0.0..126.255.255.255}∪ {128.0.0.0..131.159.15.239}∪ {131.159.16.0..131.159.20.255}∪ {131.159.22.0..255.255.255.255} {131.159.21.0..131.159.21.255}{131.159.15.240..131.159.15.255} {127.0.0.0..127.255.255.255} Fig. 7 Service matrix of ruleset in Fig. 6 a good sign. However, localhost traffic is usually not interesting for a firewall analysis since this range is usually not routed [15]. We will ignore it from now. On the top, in the cloud, we see a large set of IP addresses. This corresponds to the Internet. On the left, we see the 131.159.21.0/24 range. It may access the Internet and the 131.159.15.240/28 range. On the right, we see the 131.159.15.240/28 range, which may only access the Internet, but not the 131.159.21.0/24 range. Carefully looking at the figure, we might recognize the overall architecture: the fire- wall implements the “Demilitarized Zone” (DMZ) architectural pattern. This can usually be described as a local network that is segmented into two parts; a public one that is reach- able from the outside Internet (hosting services that need to be reachable from the outside, e.g., a mail or a web server) and an internal one that can only connect to the Internet, but not the opposite direction. To mitigate a situation where some host in the public segment gets compromised, the firewall also prohibits connection from the public into the internal segment. Starting from the original iptables-save input, without the help of fffuu,this architecture would have been difficult to uncover and verify. 14 Evaluation We obtained real-world rulesets from over 15 firewalls. Some are central, production-critical devices. They are written by different authors, utilize a vast amount of different features and exhibit different styles and patterns. The fact that we publish the complete rulesets is an important contribution (cf. Wool [82,84]). To the best of our knowledge, this is the largest, publicly available collection of real-world iptables rulesets. Note: some administrators wish 123 Verified iptables Firewall Analysis and Verification 229 to remain anonymous so we replaced their public IP addresses with public IP ranges of our institute, preserving all IP subset relationships. Table 1 summarizes the evaluation’s results. The first column (“Fw”) labels the analyzed ruleset. Column 2 (“Rules”) contains the number of rules (only the filter table) in the output of iptables-save. We work directly on these real-world data sets. Column 3 describes the analyzed chain. Depending on the type of firewall, we either analyzed the FORWARD (“FW”) or the INPUT (“IN”) chain. For a host firewall, we analyzed IN; for a network firewall, e.g., on a gateway or router, we analyzed FW. In parentheses, we wrote the number of rules after unfolding the analyzed chain. The unfolding also features some generic, straight-forward optimizations, such as removing rules where the match expression is ¬ Any. Column 4 (“Simple rules”) is the number of rules when translated to the simple firewall. In parentheses, we wrote the number of simple firewall rules when interfaces are removed. This ruleset is used subsequently to compute the partitions and service matrices. In column 5 (“Use”), we mark whether the translated simple firewall is useful. We will detail on the metric later. Column 6 (“Parts”) lists the number of IP address space partitions. For comparison, we give the number of partitions computed by ITVal in parentheses. In Columns 7 and 8, we give the number of partitions for the service matrices for SSH and HTTP. In column 9 (“Time (ITVal)”), for comparison, we put the runtime of the partitioning by ITVal in parentheses in seconds, minutes, or hours. In column 10 (“Time (this)”), we give the overall runtime of our analysis. When translating to the simple firewall, to accomplish support for arbitrary matching primitives, some approximations need to be performed. For every firewall, the first row states the overapproximation (more permissive), the second row the underapproximation (more strict). In contrast to the intermediate evaluation, there is no longer the need to manually exclude certain rules from the analysis (cf. Sect. 6.4). For some rulesets, we do not know the interface configuration. For others, there were zone-spanning interfaces. For these reasons, as proven in Sect. 11.6, in the majority of cases, we could not rewrite interfaces. This is one reason for the differences between over- and underapproximation. We loaded all translated simple firewall rulesets (without interfaces) with iptables-res tore. This validates that our results are well-formed. We then used iptables directly to gen- erate the firewall format required by ITVal (iptables -L -n). Our translation to the simple firewall is required because ITVal cannot understand the original complex rulesets and produces flawed results for them. Performance. We have two possibilities to execute our algorithms, depending on whether the user wants to run them inside of Isabelle or as an external stand-alone application [34]. For our evaluation, we utilize Isabelle’s code reflection capabilities. In essence, it gives us a way to execute our algorithms as if they were implemented in Isabelle’s implementation language (Standard ML). Isabelle’s code generator introduces its own unoptimized version for data structures that are already present in the standard libraries of many programming languages. Hence, the generated code may be quite inefficient. For example, lookups in Isabelle-generated dictionaries have linear lookup time, compared to constant lookup time of standard library implementations. In contrast, ITVal is highly optimized C++ code. We benchmarked our tool on a commodity i7-2620M laptop with 2 physical cores and 8 GB of RAM. In contrast, we executed ITVal on a server with 16 physical Xeon E5-2650 cores There are methods to improve the performance and provably preserve correctness [43,44], which are out of the scope of this article. 123 230 C. Diekmann et al. and 128 GB RAM. The runtime measured for our tool is the complete translation to the two simple firewalls, computation of partitions, and the two service matrices. In contrast, the runtime of ITVal only consists of computing one partition. The reported time of our tool also includes the runtime of Isabelle’s code generator, but for ITVal we did not add its compilation time. This is one reason why ITVal outperforms our tool for runtimes of <1min. These benchmark settings are biased against our tool. Indeed, exporting our tool to a stan- dalone Haskell application instead, replacing some common data structures with optimized ones from the Haskell standard library, enabling aggressive compiler optimization and paral- lelization, not counting compilation time, and running our tool on the Xeon server, the runtime of our tool improves by orders of magnitude. Our stand-alone tool fffuu also achieves a better runtime by orders of magnitude. Nevertheless, we chose the “unfair” setting to demonstrate the feasibility of running verified code directly in a theorem prover. Table 1 shows that our tool outperforms ITVal for large firewalls. We added ITVal’s memory requirements to the table if they exceeded 20 GB. ITVal requires an infeasible amount of memory for larger rulesets while our tool can finish on commodity hardware. The overall numbers show that the runtime for our tool is sufficient for static, offline analysis, even for large real-word rulesets. For our daily use and convenience, we use our Haskell tool fffuu which adds another order of magnitude of speedup to our numbers of Table 1. Quality of results. The main goal of ITVal is to compute a minimal partitioning while ours may not be minimal. A smaller number of partitions is better, since the result is more over- seeable. It can be seen that ITVal provides better results than our approach in Column 6. Since a service matrix is more specific than a partitioning, the partitions of a service matrix (Column 7 and 8) can be even smaller. Our service matrices are provably minimal and thus improve on ITVal’s partitioning. Since a partitioning cannot be smaller than a service matrix, the numbers in Column 6 must be greater or equal than the numbers in Column 7 or 8. For firewalls A and R, it can be seen that ITVals’s results are spurious, while ours are provably correct. In general, if the number of partitions calculated by ITVal is smaller than those of a service matrix, this is an error in ITVal. In Column 5, we show the usefulness of the translated simple firewall (including interfaces). We deem a firewall useful if interesting information was preserved by the approxi- mation. Therefore, we manually inspected the rulesest and compared it to the original. For the overapproximation, we focused on preserved (non-shadowed) Drop rules. For the underap- proximation, we focused on preserved (non-shadowed) Accept rules. If the firewall features some rate-limiting for all packets in the beginning, the underapproximation is naturally a drop- all ruleset because the rate-limiting could apply to all packets. According to our metric, such a ruleset is of no use (but the only sound solution). We indicate this case with a superscript . The table indicates that, usually, at least one approximation per firewall is useful. For brevity, we only elaborate on the most interesting rulesets and consequences of their analysis. Firewall A. This firewall is the core firewall of our lab (Chair of Network Architectures and Services). It has two uplinks, interconnects several VLANs, and matches on more than 20 interfaces. It has around 500 direct users and one transfer network for an autonomous system (AS) behind it. The traffic is usually several Mbit/s. We have analyzed dumps from Oct 2013, Sep 2014, May 2015, and Sep 2015. The changing number of rules indicates that it is actively managed. 123 Verified iptables Firewall Analysis and Verification 231 The firewall starts with some rate-limiting rules. Therefore, its stricter approximation assumes that the rate-limiting always applies and transforms the ruleset into a deny-all ruleset. The more permissive approximation abstracts over this rate-limiting and provides a very good approximation of the original ruleset. The SSH service matrix is visualized in Fig. 8 and in Fig. 9 with the raw IP addresses. The figure can be read as follows: the vast majority of our IP addresses are grouped into internal and servers. Servers are reachable from the outside, internal hosts are not. ip and ip are two individual IP addresses with special exceptions. There is also a group for the backbone routers of the connected AS. INET is the set of IP addresses which does not belong to us, basically the Internet. INET’ is another part of the Internet. With the help of the service matrix, the administrator confirmed that the existence of INET’ was an error caused by a stale rule. The misconfiguration has been fixed. Figure 8 summarizes over 4000 firewall rules and helps to easily visually verify the complex SSH setup of our firewall. The administrator was also interested in the Kerberos (kerberos-adm) and LDAP service matrices. They helped verifying the complex setup and discovered potential for ruleset cleanup. We have used the fffuu tool further on to analyze our firewall. For example, Figs. 10 (IPv4) and 11 (IPv6) were created from a recent snapshot of June 2016 and depict the service matrix for HTTP. This snapshot is not listed in the table. The figures show the raw IP addresses. It can be seen that the “two INETs” bug has been fixed, but the overall complexity of the firewall increased. Note that the service matrix is minimal, i.e., there is no way to compress it any further. The two figures reveal the intrinsic complexity of this firewall. However, the figures, though complicated, can still be visualized on one page. This would be impossible for the thousands of rules of the actual ruleset. It demonstrates that our service matrices can give a suitable overview of complicated rulesets. Firewall D. This firewall was taken from a Shorewall system with 373 rules and 65 chains. It can be seen that unfolding increases the number of rules, because of the complex call structures generated by the user-defined chains. Transforming to the simple firewall further increases the ruleset size. This is, among other reasons, due to rewriting several negated IP matches back to non-negated CIDR ranges and NNF normalization. However, the absolute numbers tell us that this blow up is no problem for computerized analysis. multicast ip INET INET’ servers AS routers localhost ip internal Fig. 8 Lab SSH Service Matrix (2015) 123 232 C. Diekmann et al. {224.0.0.0..239.255.255.255} {0.0.0.0..126.255.255.255}∪{128.0.0.0..131.158.255.255}∪ 131.159.15.54 {131.160.0.0..138.246.253.4}∪{138.246.253.6..185.86.231.255}∪ {185.86.236.0..188.1.239.85}∪{188.1.239.87..188.95.232.63}∪ {188.95.232.224..188.95.232.255}∪{188.95.240.0..192.48.106.255}∪ {192.48.108.0..223.255.255.255}∪{240.0.0.0..255.255.255.255} {131.159.14.8..131.159.14.11}∪131.159.14.22 ∪131.159.14.26 ∪131.159.14.28 ∪188.1.239.86 ∪{188.95.232.64..188.95.232.191} {131.159.14.34..131.159.14.37}∪131.159.14.40∪131.159.14.42∪131.159.14.52∪ 131.159.14.56∪131.159.14.58∪131.159.14.69∪131.159.14.83∪131.159.14.104∪ 131.159.14.111 ∪ 131.159.14.125 ∪ 131.159.14.137 ∪ 131.159.14.140 ∪ {131.159.14.145..131.159.14.146}∪{131.159.14.155..131.159.14.156}∪ 131.159.14.163 ∪ 131.159.14.169 ∪ 131.159.14.201 ∪ 131.159.14.214 ∪ 131.159.15.5∪{131.159.15.7..131.159.15.13}∪{131.159.15.16..131.159.15.20}∪ {131.159.15.23..131.159.15.25}∪ 131.159.15.27 ∪ 131.159.15.29 ∪ 131.159.15.32∪131.159.15.36∪131.159.15.39∪{131.159.15.42..131.159.15.44}∪ {131.159.15.47..131.159.15.48}∪ 131.159.15.56 ∪ 131.159.15.58 ∪ 131.159.15.60 ∪ 131.159.15.69 ∪ 131.159.15.197 ∪ 131.159.15.228 ∪ 131.159.15.234 ∪{131.159.15.247..131.159.15.249}∪ 131.159.20.21 ∪ {131.159.20.29..131.159.20.30}∪131.159.20.36∪131.159.20.45∪131.159.20.52∪ {131.159.0.0..131.159.13.255}∪ 131.159.20.59 ∪131.159.20.63 ∪131.159.20.71 ∪131.159.20.74 ∪131.159.20.85 ∪ {131.159.16.0..131.159.19.255}∪ 131.159.20.97 ∪ 131.159.20.118 ∪ 131.159.20.120 ∪ 131.159.20.124 ∪ {131.159.22.0..131.159.255.255} 131.159.20.139 ∪{131.159.20.150..131.159.20.151}∪ 131.159.20.155 ∪ 131.159.20.160 ∪{131.159.20.165..131.159.20.166}∪ 131.159.20.180 ∪ 131.159.20.185 ∪ 131.159.20.200 ∪{131.159.20.233..131.159.20.234}∪ {131.159.21.0..131.159.21.255}∪{188.95.232.192..188.95.232.223}∪ 188.95.233.4 ∪ 188.95.233.9 ∪{188.95.234.0..188.95.239.255} 138.246.253.5 {131.159.14.0..131.159.14.7}∪{131.159.14.12..131.159.14.21}∪ {131.159.14.23..131.159.14.25}∪ 131.159.14.27 ∪ {127.0.0.0..127.255.255.255} {131.159.14.29..131.159.14.33}∪{131.159.14.38..131.159.14.39}∪ 131.159.14.41 ∪{131.159.14.43..131.159.14.51}∪ {131.159.14.53..131.159.14.55}∪ 131.159.14.57 ∪ {131.159.14.59..131.159.14.68}∪{131.159.14.70..131.159.14.82}∪ {131.159.14.84..131.159.14.103}∪{131.159.14.105..131.159.14.110}∪ {131.159.14.112..131.159.14.124}∪{131.159.14.126..131.159.14.136}∪ {131.159.14.138..131.159.14.139}∪{131.159.14.141..131.159.14.144}∪ {131.159.14.147..131.159.14.154}∪{131.159.14.157..131.159.14.162}∪ {131.159.14.164..131.159.14.168}∪{131.159.14.170..131.159.14.200}∪ {131.159.14.202..131.159.14.213}∪{131.159.14.215..131.159.15.4}∪ 131.159.15.6 ∪{131.159.15.14..131.159.15.15}∪ {131.159.15.21..131.159.15.22}∪ 131.159.15.26 ∪ 131.159.15.28 ∪ {131.159.15.30..131.159.15.31}∪{131.159.15.33..131.159.15.35}∪ {131.159.15.37..131.159.15.38}∪{131.159.15.40..131.159.15.41}∪ {131.159.15.45..131.159.15.46}∪{131.159.15.49..131.159.15.53}∪ 131.159.15.55∪131.159.15.57∪131.159.15.59∪{131.159.15.61..131.159.15.68}∪ {131.159.15.70..131.159.15.196}∪{131.159.15.198..131.159.15.227}∪ {131.159.15.229..131.159.15.233}∪{131.159.15.235..131.159.15.246}∪ {131.159.15.250..131.159.15.255}∪{131.159.20.0..131.159.20.20}∪ {131.159.20.22..131.159.20.28}∪{131.159.20.31..131.159.20.35}∪ {131.159.20.37..131.159.20.44}∪{131.159.20.46..131.159.20.51}∪ {131.159.20.53..131.159.20.58}∪{131.159.20.60..131.159.20.62}∪ {131.159.20.64..131.159.20.70}∪{131.159.20.72..131.159.20.73}∪ {131.159.20.75..131.159.20.84}∪{131.159.20.86..131.159.20.96}∪ {131.159.20.98..131.159.20.117}∪ 131.159.20.119 ∪ {131.159.20.121..131.159.20.123}∪{131.159.20.125..131.159.20.138}∪ {131.159.20.140..131.159.20.149}∪{131.159.20.152..131.159.20.154}∪ {131.159.20.156..131.159.20.159}∪{131.159.20.161..131.159.20.164}∪ {131.159.20.167..131.159.20.179}∪{131.159.20.181..131.159.20.184}∪ {131.159.20.186..131.159.20.199}∪{131.159.20.201..131.159.20.232}∪ {131.159.20.235..131.159.20.255}∪{185.86.232.0..185.86.235.255}∪ {188.95.233.0..188.95.233.3}∪{188.95.233.5..188.95.233.8}∪ {188.95.233.10..188.95.233.255}∪{192.48.107.0..192.48.107.255} Fig. 9 Lab SSH Service Matrix with raw IP addresses (2015) Roughly speaking, the firewall connects interfaces to each other, i.e., it heavily uses -i and -o. This can be easily seen in the overapproximation. There are also many zone-spanning interfaces. As we have proven, it is impossible to rewrite interfaces in this case. In addition, for some interfaces, no IP ranges are specified. Hence, this ruleset is more of a link layer firewall than a network layer firewall. Consequently, the service matrices are barely of any use. Later on, having obtained more detailed interface and routing configurations, we tried again with input and output port rewriting. The result is not shown in the table, but visualized in Fig. 12. The figure now correctly summarizes the network architecture enforced by the firewall. It shows the general Internet, a Debian update server (141.76.2.4), and four internal networks with different access rights. Firewall E. This ruleset was taken from a NAS device from the introduction (Fig. 1). The ruleset first performs some rate-limiting. Consequently, the underapproximation corresponds to the deny-all ruleset. The table lists a more recent version of the ruleset after a system update. Our SSH service matrix reveals a misconfiguration: SSH was accidentally left enabled after 123 Verified iptables Firewall Analysis and Verification 233 {0.0.0.0..45.56.113.32}∪{45.56.113.34..80.81.195.255}∪ {80.81.197.0..81.169.253.163}∪{81.169.253.165..85.214.129.213}∪ {85.214.129.215..94.186.159.97}∪ {94.186.159.99..126.255.255.255}∪{128.0.0.0..131.159.13.255}∪ {131.159.16.0..131.159.19.255}∪{131.159.22.0..138.246.252.255}∪ {138.246.254.0..148.251.90.44}∪{148.251.90.46..185.86.231.255}∪ {185.86.236.0..188.1.239.85}∪{188.1.239.87..188.95.232.63}∪ {188.95.232.224..188.95.232.255}∪{188.95.240.0..192.48.106.255}∪ {192.48.108.0..223.255.255.255}∪{240.0.0.0..255.255.255.255} {131.159.14.0..131.159.14.10}∪{131.159.14.12..131.159.14.25}∪ 131.159.14.11 ∪ 131.159.14.26 ∪ 131.159.14.36 ∪ 131.159.14.42 ∪ 131.159.14.47 ∪ 131.159.14.60 ∪ 131.159.14.63 ∪ 131.159.14.85 ∪ {131.159.14.27..131.159.14.35}∪{131.159.14.37..131.159.14.41}∪ 131.159.14.125 ∪ 131.159.14.140 ∪{131.159.14.145..131.159.14.146}∪ {131.159.14.43..131.159.14.46}∪{131.159.14.48..131.159.14.59}∪ 131.159.14.169 ∪ 131.159.14.204 ∪ 131.159.14.214 ∪ 131.159.14.221 ∪ {131.159.14.61..131.159.14.62}∪{131.159.14.64..131.159.14.84}∪ {131.159.15.4..131.159.15.5}∪ 131.159.15.7 ∪ 131.159.15.9 ∪ 131.159.15.11 ∪ {131.159.14.86..131.159.14.124}∪{131.159.14.126..131.159.14.139}∪ {131.159.14.141..131.159.14.144}∪{131.159.14.147..131.159.14.168}∪ {131.159.15.13..131.159.15.14}∪{131.159.15.16..131.159.15.17}∪ {131.159.14.170..131.159.14.203}∪{131.159.14.205..131.159.14.208}∪ {131.159.15.20..131.159.15.21}∪ 131.159.15.23 ∪ {131.159.14.210..131.159.14.211}∪ 131.159.14.213 ∪ {131.159.15.26..131.159.15.27}∪{131.159.15.29..131.159.15.36}∪ {131.159.14.217..131.159.14.220}∪{131.159.14.222..131.159.15.3}∪ {131.159.15.38..131.159.15.39}∪ 131.159.15.6 ∪ 131.159.15.8 ∪ 131.159.15.10 ∪ 131.159.15.12 ∪ 131.159.15.15 ∪ {131.159.15.41..131.159.15.42..131.159.15.44}∪ {131.159.15.18..131.159.15.19}∪ 131.159.15.22 ∪ {131.159.15.46..131.159.15.49}∪ 131.159.15.51 ∪ {131.159.15.24..131.159.15.25}∪131.159.15.28∪131.159.15.37∪131.159.15.40∪ {131.159.15.53..131.159.15.54}∪{131.159.15.56..131.159.15.59}∪ 131.159.15.68 ∪ 131.159.15.226 ∪ 131.159.15.229 ∪ 131.159.15.233 ∪ 131.159.15.45∪131.159.15.52∪131.159.15.55∪{131.159.15.60..131.159.15.67}∪ {131.159.15.246..131.159.15.248}∪ 131.159.20.42 ∪ 131.159.20.45 ∪ {131.159.15.69..131.159.15.225}∪{131.159.15.227..131.159.15.228}∪ 131.159.20.52 ∪ 131.159.20.59 ∪ 131.159.20.72 ∪ 131.159.20.155 ∪ {131.159.15.230..131.159.15.232}∪{131.159.15.234..131.159.15.245}∪ 131.159.20.202 ∪ 131.159.20.243 ∪{131.159.21.0..131.159.21.255}∪ {131.159.15.249..131.159.15.255}∪{131.159.20.0..131.159.20.41}∪ {131.159.20.43..131.159.20.44}∪{131.159.20.46..131.159.20.51}∪ {185.86.232.0..185.86.235.255}∪{188.95.232.192..188.95.232.223}∪ {131.159.20.53..131.159.20.58}∪{131.159.20.60..131.159.20.71}∪ {188.95.233.4..188.95.233.5}∪ 188.95.233.9 ∪{188.95.234.0..188.95.239.255} {131.159.20.73..131.159.20.154}∪{131.159.20.156..131.159.20.201}∪ {131.159.20.203..131.159.20.242}∪{131.159.20.244..131.159.20.255}∪ {188.95.233.0..188.95.233.3}∪{188.95.233.6..188.95.233.8}∪ {188.95.233.10..188.95.233.255}∪{192.48.107.0..192.48.107.255} {138.246.253.6..138.246.253.10}∪ 138.246.253.19 {224.0.0.0..239.255.255.255} {127.0.0.0..127.255.255.255} 131.159.14.212 ∪ {131.159.14.215..131.159.14.216} 138.246.253.5 131.159.15.50 {80.81.196.0..80.81.196.255} 45.56.113.33 ∪ 81.169.253.164 ∪ 188.1.239.86 ∪{188.95.232.64..188.95.232.191} 85.214.129.214 ∪ 94.186.159.98 ∪ 148.251.90.45 131.159.14.209 {138.246.253.0..138.246.253.4}∪ {138.246.253.11..138.246.253.18}∪ {138.246.253.20..138.246.253.255} Fig. 10 Lab IPv4 HTTP Service Matrix (2016) the update. After this discovery, the flaw was fixed. The service matrix for the other services provided by the NAS (not listed in the table) verifies that these services are only accessible from the local network. This finally yields the expected result as motivated in the introduction. Firewall F. This firewall is running on a publicly accessible server. The firewall first allows everything for localhost, then blocks IP addresses which have shown malicious behavior in the past, and finally allows certain services. Since most rules are devoted to blocking malicious IPs, our IP address space partition roughly grows linearly with the number of rules. The service matrices, however, reveal that there are actually only three classes of IP ranges: localhost, the blocked IPs, and all other IPs which are granted access to the services. Firewall G. For this production server, the service matrices verified that a SQL daemon is only accessible from a local network and three explicitly-defined public IP addresses. Our tool could verify the belief of the administrator that the firewall is configured correctly. 123 234 C. Diekmann et al. :: ∪{::2 .. 2001:638:c:a09d::1}∪{2001:638:c:a09d::3 .. 2001:4ca0:108:41:ffff:ffff:ffff:ffff}∪ {2001:4ca0:108:43:: .. 2001:4ca0:2001:9:ffff:ffff:ffff:ffff}∪{2001:4ca0:2001:b:: .. 2001:4ca0:2001:f:ffff:ffff:ffff:ffff}∪{2001:4ca0:2001:16:: .. 2001:4ca0:2001:16:ffff:ffff:ffff:ffff}∪ {2001:4ca0:2001:1a:: .. 2001:4ca0:2001:1f:ffff:ffff:ffff:ffff}∪{2001:4ca0:2001:22:: .. 2001:4ca0:2001:2f:ffff:ffff:ffff:ffff}∪{2001:4ca0:2001:31:: .. 2001:4ca0:2001:3f:ffff:ffff:ffff:ffff}∪ {2001:4ca0:2001:41:: .. 2001:4ca0:2001:41:ffff:ffff:ffff:ffff}∪{2001:4ca0:2001:43:: .. 2600:3c02::f03c:91ff:fe84:a74}∪{2600:3c02::f03c:91ff:fe84:a76 .. 2a00:4700::ffff:ffff:ffff:ffff}∪ {2a00:4700:0:8:: .. 2a00:4700:0:8:ffff:ffff:ffff:ffff}∪{2a00:4700:0:a:: .. 2a01:238:4270:b800:a7dc:c448:3f2:3ce2}∪{2a01:238:4270:b800:a7dc:c448:3f2:3ce4 .. 2a01:238:43d7:c300:74c7:3bfe:cceb:ee02}∪{2a01:238:43d7:c300:74c7:3bfe:cceb:ee04 .. 2a01:4f8:202:702c::1}∪{2a01:4f8:202:702c::3 .. feff:ffff:ffff:ffff:ffff:ffff:ffff:ffff} 2001:638:c:a09d::2 ∪{2001:4ca0:2001:10:: .. 2001:4ca0:2001:10:201:80ff:fe7f:6d86}∪{2001:4ca0:2001:10:201:80ff:fe7f:6d88 .. {2001:4ca0:2001:a:: .. 2001:4ca0:2001:a:ffff:ffff:ffff:ffff}∪ 2001:4ca0:2001:10:201:80ff:fe7f:6d87 ∪ 2001:4ca0:2001:10:211:2fff:feb5:9192}∪{2001:4ca0:2001:10:211:2fff:feb5:9194 .. 2001:4ca0:2001:10:214:bff:fe60:16f3}∪ 2001:4ca0:2001:10:211:2fff:feb5:9193 ∪ 2001:4ca0:2001:10:214:bff:fe60:16f4 ∪ 2001:4ca0:2001:10:216:3eff:fe38:14e1 ∪ {2001:4ca0:2001:10:214:bff:fe60:16f5 .. 2001:4ca0:2001:10:216:3eff:fe38:14e0}∪{2001:4ca0:2001:10:216:3eff:fe38:14e2 .. 2001:4ca0:2001:10:216:3eff:fe51:7871 ∪ 2001:4ca0:2001:10:216:3eff:fe68:84d3 ∪ 2001:4ca0:2001:10:225:90ff:fedb:c720 ∪ 2001:4ca0:2001:10:216:3eff:fe51:7870}∪{2001:4ca0:2001:10:216:3eff:fe51:7872 .. 2001:4ca0:2001:10:216:3eff:fe68:84d2}∪ 2001:4ca0:2001:10:230:48ff:febb:4bca ∪ 2001:4ca0:2001:10:2e0:81ff:fec6:74bd ∪{2001:4ca0:2001:10:2e0:81ff:fec6:75fe .. {2001:4ca0:2001:10:216:3eff:fe68:84d4 .. 2001:4ca0:2001:10:225:90ff:fedb:c71f}∪{2001:4ca0:2001:10:225:90ff:fedb:c721 .. 2001:4ca0:2001:10:2e0:81ff:fec6:75ff}∪ 2001:4ca0:2001:11:210:18ff:fe91:1901 ∪ 2001:4ca0:2001:11:214:bff:fe6f:2ab1 ∪ 2001:4ca0:2001:10:230:48ff:febb:4bc9}∪{2001:4ca0:2001:10:230:48ff:febb:4bcb .. 2001:4ca0:2001:10:2e0:81ff:fec6:74bc}∪ 2001:4ca0:2001:11:216:3eff:fe07:16f9 ∪ 2001:4ca0:2001:11:225:90ff:fe7a:cb82 ∪ 2001:4ca0:2001:11:225:90ff:fed7:8914 ∪ {2001:4ca0:2001:10:2e0:81ff:fec6:74be .. 2001:4ca0:2001:10:2e0:81ff:fec6:75fd}∪{2001:4ca0:2001:10:2e0:81ff:fec6:7600 .. 2001:4ca0:2001:11:226:22ff:fea1:2382 ∪ 2001:4ca0:2001:11:226:b9ff:fe7d:84ed ∪ 2001:4ca0:2001:11:2e0:81ff:fe2d:f16 ∪ 2001:4ca0:2001:11:210:18ff:fe91:1900}∪{2001:4ca0:2001:11:210:18ff:fe91:1902 .. 2001:4ca0:2001:11:214:bff:fe6f:2ab0}∪ 2001:4ca0:2001:11:be30:5bff:fed4:bfee ∪ 2001:4ca0:2001:13::42 ∪ 2001:4ca0:2001:13:216:3eff:fe03:34f8 ∪ {2001:4ca0:2001:11:214:bff:fe6f:2ab2 .. 2001:4ca0:2001:11:216:3eff:fe07:16f8}∪{2001:4ca0:2001:11:216:3eff:fe07:16fa .. 2001:4ca0:2001:13:216:3eff:fe04:da66 ∪ 2001:4ca0:2001:13:216:3eff:fe10:a5d9 ∪ 2001:4ca0:2001:13:216:3eff:fe16:d255 ∪ 2001:4ca0:2001:11:225:90ff:fe7a:cb81}∪{2001:4ca0:2001:11:225:90ff:fe7a:cb83 .. 2001:4ca0:2001:11:225:90ff:fed7:8913}∪ 2001:4ca0:2001:13:216:3eff:fe1c:a6f5 ∪ 2001:4ca0:2001:13:216:3eff:fe30:d8c7 ∪{2001:4ca0:2001:13:216:3eff:fe32:c969 .. {2001:4ca0:2001:11:225:90ff:fed7:8915 .. 2001:4ca0:2001:11:226:22ff:fea1:2381}∪{2001:4ca0:2001:11:226:22ff:fea1:2383 .. 2001:4ca0:2001:13:216:3eff:fe32:c96a}∪ 2001:4ca0:2001:13:216:3eff:fe39:a31f ∪ 2001:4ca0:2001:13:216:3eff:fe45:42 ∪ 2001:4ca0:2001:11:226:b9ff:fe7d:84ec}∪{2001:4ca0:2001:11:226:b9ff:fe7d:84ee .. 2001:4ca0:2001:11:2e0:81ff:fe2d:f15}∪ 2001:4ca0:2001:13:216:3eff:fe50:e76b ∪ 2001:4ca0:2001:13:216:3eff:fe5b:5e87 ∪ 2001:4ca0:2001:13:216:3eff:fe5f:b83f ∪ {2001:4ca0:2001:11:2e0:81ff:fe2d:f17 .. 2001:4ca0:2001:11:be30:5bff:fed4:bfed}∪{2001:4ca0:2001:11:be30:5bff:fed4:bfef .. 2001:4ca0:2001:13:216:3eff:fe60:442a ∪ 2001:4ca0:2001:13:216:3eff:fe6e:ade7 ∪ 2001:4ca0:2001:13:216:3eff:fe75:7acd ∪ 2001:4ca0:2001:13::41}∪{2001:4ca0:2001:13::43 .. 2001:4ca0:2001:13:216:3eff:fe03:34f7}∪{2001:4ca0:2001:13:216:3eff:fe03:34f9 2001:4ca0:2001:13:216:3eff:fe76:6aae ∪ 2001:4ca0:2001:13:216:3eff:fe96:6bbc ∪ 2001:4ca0:2001:13:216:3eff:fea0:37e5 ∪ .. 2001:4ca0:2001:13:216:3eff:fe04:da65}∪{2001:4ca0:2001:13:216:3eff:fe04:da67 .. 2001:4ca0:2001:13:216:3eff:fe10:a5d8}∪ 2001:4ca0:2001:13:216:3eff:fea6:878b ∪ 2001:4ca0:2001:13:216:3eff:fea7:6ad5 ∪ 2001:4ca0:2001:13:216:3eff:fea8:cbf3 ∪ {2001:4ca0:2001:13:216:3eff:fe10:a5da .. 2001:4ca0:2001:13:216:3eff:fe16:d254}∪{2001:4ca0:2001:13:216:3eff:fe16:d256 .. 2001:4ca0:2001:13:216:3eff:fead:288c ∪ 2001:4ca0:2001:13:216:3eff:feb0:5c43 ∪ 2001:4ca0:2001:13:216:3eff:fec2:1264 ∪ 2001:4ca0:2001:13:216:3eff:fe1c:a6f4}∪{2001:4ca0:2001:13:216:3eff:fe1c:a6f6 .. 2001:4ca0:2001:13:216:3eff:fe30:d8c6}∪ 2001:4ca0:2001:13:216:3eff:fec7:6d64 ∪ 2001:4ca0:2001:13:216:3eff:fece:fe68 ∪ 2001:4ca0:2001:13:216:3eff:fee1:6973 ∪ {2001:4ca0:2001:13:216:3eff:fe30:d8c8 .. 2001:4ca0:2001:13:216:3eff:fe32:c968}∪{2001:4ca0:2001:13:216:3eff:fe32:c96b .. 2001:4ca0:2001:13:216:3eff:fee9:36a6 ∪ 2001:4ca0:2001:13:216:3eff:fee9:a554 ∪ 2001:4ca0:2001:13:216:3eff:feea:2fb7 ∪ 2001:4ca0:2001:13:216:3eff:fe39:a31e}∪{2001:4ca0:2001:13:216:3eff:fe39:a320 .. 2001:4ca0:2001:13:216:3eff:fe45:41}∪ 2001:4ca0:2001:13:216:3eff:fefe:ce2e ∪ 2001:4ca0:2001:13:219:b9ff:feea:4ce0 ∪ 2001:4ca0:2001:13:219:b9ff:feea:4ce2 ∪ {2001:4ca0:2001:13:216:3eff:fe45:43 .. 2001:4ca0:2001:13:216:3eff:fe50:e76a}∪{2001:4ca0:2001:13:216:3eff:fe50:e76c .. 2001:4ca0:2001:13:250:56ff:fe9d:955 ∪ 2001:4ca0:2001:13:be5f:f4ff:fe4a:497f ∪ 2001:4ca0:2001:14:216:3eff:fe52:ed14 ∪ 2001:4ca0:2001:13:216:3eff:fe5b:5e86}∪{2001:4ca0:2001:13:216:3eff:fe5b:5e88 .. 2001:4ca0:2001:13:216:3eff:fe5f:b83e}∪ 2001:4ca0:2001:14:216:3eff:feff:d683 ∪ 2001:4ca0:2001:17:216:3eff:fe75:f85c ∪ 2001:4ca0:2001:18:216:3eff:fef0:3933 ∪ {2001:4ca0:2001:13:216:3eff:fe5f:b840 .. 2001:4ca0:2001:13:216:3eff:fe60:4429}∪{2001:4ca0:2001:13:216:3eff:fe60:442b .. {2001:4ca0:2001:19:: .. 2001:4ca0:2001:19:ffff:ffff:ffff:ffff}∪ 2001:4ca0:2001:21:216:3eff:fec6:7b51 ∪ 2001:4ca0:2001:13:216:3eff:fe6e:ade6}∪{2001:4ca0:2001:13:216:3eff:fe6e:ade8 .. 2001:4ca0:2001:13:216:3eff:fe75:7acc}∪ 2001:4ca0:2001:40:21b:21ff:fe29:a5cd ∪ 2001:4ca0:2001:40:21d:baff:fe5c:9cf3 ∪ 2001:4ca0:2001:40:21f:d0ff:fe46:17df ∪ {2001:4ca0:2001:13:216:3eff:fe75:7ace .. 2001:4ca0:2001:13:216:3eff:fe76:6aad}∪{2001:4ca0:2001:13:216:3eff:fe76:6aaf .. {2001:4ca0:2001:42:: .. 2001:4ca0:2001:42:ffff:ffff:ffff:ffff}∪{2a00:4700:0:2:21b:21ff:fe42:301c .. 2001:4ca0:2001:13:216:3eff:fe96:6bbb}∪{2001:4ca0:2001:13:216:3eff:fe96:6bbd .. 2001:4ca0:2001:13:216:3eff:fea0:37e4}∪ 2a00:4700:0:2:21b:21ff:fe42:301d}∪{2a00:4700:0:2:225:90ff:fe7a:cbc8 .. 2a00:4700:0:2:225:90ff:fe7a:cbc9}∪ {2001:4ca0:2001:13:216:3eff:fea0:37e6 .. 2001:4ca0:2001:13:216:3eff:fea6:878a}∪{2001:4ca0:2001:13:216:3eff:fea6:878c .. 2a00:4700:0:2:2e0:81ff:fe2f:fd9d ∪{2a00:4700:0:2:2e0:81ff:fe2f:fde2 .. 2a00:4700:0:2:2e0:81ff:fe2f:fde3}∪ 2001:4ca0:2001:13:216:3eff:fea7:6ad4}∪{2001:4ca0:2001:13:216:3eff:fea7:6ad6 .. 2001:4ca0:2001:13:216:3eff:fea8:cbf2}∪ {2a00:4700:0:2:2e0:81ff:feb9:3824 .. 2a00:4700:0:2:2e0:81ff:feb9:3825}∪{2a00:4700:0:3:: .. 2a00:4700:0:3:ffff:ffff:ffff:ffff}∪ {2001:4ca0:2001:13:216:3eff:fea8:cbf4 .. 2001:4ca0:2001:13:216:3eff:fead:288b}∪{2001:4ca0:2001:13:216:3eff:fead:288d .. {2a00:4700:0:6:: .. 2a00:4700:0:7:ffff:ffff:ffff:ffff}∪{2a00:4700:0:9:: .. 2a00:4700:0:9:ffff:ffff:ffff:ffff} 2001:4ca0:2001:13:216:3eff:feb0:5c42}∪{2001:4ca0:2001:13:216:3eff:feb0:5c44 .. 2001:4ca0:2001:13:216:3eff:fec2:1263}∪ {2001:4ca0:2001:13:216:3eff:fec2:1265 .. 2001:4ca0:2001:13:216:3eff:fec7:6d63}∪{2001:4ca0:2001:13:216:3eff:fec7:6d65 .. 2001:4ca0:2001:13:216:3eff:fece:fe67}∪{2001:4ca0:2001:13:216:3eff:fece:fe69 .. 2001:4ca0:2001:13:216:3eff:fee1:6972}∪ {2001:4ca0:2001:13:216:3eff:fee1:6974 .. 2001:4ca0:2001:13:216:3eff:fee9:36a5}∪{2001:4ca0:2001:13:216:3eff:fee9:36a7 .. 2001:4ca0:2001:13:216:3eff:fee9:a553}∪{2001:4ca0:2001:13:216:3eff:fee9:a555 .. 2001:4ca0:2001:13:216:3eff:feea:2fb6}∪ {2001:4ca0:2001:13:216:3eff:feea:2fb8 .. 2001:4ca0:2001:13:216:3eff:fefe:ce2d}∪{2001:4ca0:2001:13:216:3eff:fefe:ce2f .. 2001:4ca0:2001:13:219:b9ff:feea:4cdf}∪ 2001:4ca0:2001:13:219:b9ff:feea:4ce1 ∪{2001:4ca0:2001:13:219:b9ff:feea:4ce3 .. 2001:4ca0:2001:13:250:56ff:fe9d:954}∪{2001:4ca0:2001:13:250:56ff:fe9d:956 .. 2001:4ca0:2001:13:2e0:81ff:feb5:afd7}∪ {2001:4ca0:2001:13:2e0:81ff:feb5:afda .. 2001:4ca0:2001:13:2e0:81ff:fee0:f02e .. 2001:4ca0:2001:13:be5f:f4ff:fe4a:497e}∪ {2001:4ca0:2001:13:be5f:f4ff:fe4a:4980 .. 2001:4ca0:2001:14:216:3eff:fe52:ed13}∪{2001:4ca0:2001:14:216:3eff:fe52:ed15 .. 2001:4ca0:2001:17:225:90ff:fe57:1ff8 2001:4ca0:2001:14:216:3eff:feff:d682}∪{2001:4ca0:2001:14:216:3eff:feff:d684 .. 2001:4ca0:2001:15:ffff:ffff:ffff:ffff}∪ {2001:4ca0:2001:17:: .. 2001:4ca0:2001:17::214}∪{2001:4ca0:2001:17::217 .. 2001:4ca0:2001:17:216:3eff:fe75:f85b}∪ {2001:4ca0:2001:17:216:3eff:fe75:f85d .. 2001:4ca0:2001:17:225:90ff:fe57:1ff7}∪{2001:4ca0:2001:17:225:90ff:fe57:1ff9 .. 2001:4ca0:2001:17:225:90ff:fe57:2259}∪{2001:4ca0:2001:17:225:90ff:fe57:225b .. 2001:4ca0:2001:17:225:90ff:fe7a:cbb9}∪ {2001:4ca0:2001:17:225:90ff:fe7a:cbbc .. 2001:4ca0:2001:17:225:90ff:fe7a:cbbd}∪{2001:4ca0:2001:17:225:90ff:fe7a:cbc0 .. 2001:4ca0:2001:18:216:3eff:fef0:3932}∪{2001:4ca0:2001:18:216:3eff:fef0:3934 .. 2001:4ca0:2001:18:ffff:ffff:ffff:ffff}∪ {2001:4ca0:2001:20:: .. 2001:4ca0:2001:21:216:3eff:fec6:7b50}∪{2001:4ca0:2001:21:216:3eff:fec6:7b52 .. 2001:4ca0:2001:21:ffff:ffff:ffff:ffff}∪{2001:4ca0:2001:30:: .. 2001:4ca0:2001:30:ffff:ffff:ffff:ffff}∪{2001:4ca0:2001:40:: .. 2001:4ca0:2001:40:21b:21ff:fe29:a5cc}∪{2001:4ca0:2001:40:21b:21ff:fe29:a5ce .. 2001:4ca0:2001:40:21d:baff:fe5c:9cf2}∪ {ff00:: .. ffff:ffff:ffff:ffff:ffff:ffff:ffff:ffff} {2001:4ca0:2001:40:21d:baff:fe5c:9cf4 .. 2001:4ca0:2001:40:21f:d0ff:fe46:17de}∪{2001:4ca0:2001:40:21f:d0ff:fe46:17e0 .. ::1 2001:4ca0:2001:40:ffff:ffff:ffff:ffff}∪{2a00:4700:0:1:: .. 2a00:4700:0:2:21b:21ff:fe42:301b}∪{2a00:4700:0:2:21b:21ff:fe42:301e .. 2a00:4700:0:2:225:90ff:fe7a:cbc7}∪{2a00:4700:0:2:225:90ff:fe7a:cbca .. 2a00:4700:0:2:2e0:81ff:fe2f:fd9c}∪ {2a00:4700:0:2:2e0:81ff:fe2f:fd9e .. 2a00:4700:0:2:2e0:81ff:fe2f:fde1}∪{2a00:4700:0:2:2e0:81ff:fe2f:fde4 .. 2a00:4700:0:2:2e0:81ff:feb9:3823}∪{2a00:4700:0:2:2e0:81ff:feb9:3826 .. 2a00:4700:0:2:ffff:ffff:ffff:ffff}∪{2a00:4700:0:4:: .. 2a00:4700:0:5:ffff:ffff:ffff:ffff} 2600:3c02::f03c:91ff:fe84:a75 ∪ 2a01:238:4270:b800:a7dc:c448:3f2:3ce3 ∪ 2a01:238:43d7:c300:74c7:3bfe:cceb:ee03 ∪ 2a01:4f8:202:702c::2 {2001:4ca0:2001:13:2e0:81ff:feb5:afd8 .. 2001:4ca0:2001:13:2e0:81ff:feb5:afd9} {2001:4ca0:2001:17::215 .. 2001:4ca0:2001:17::216}∪ 2001:4ca0:2001:17:225:90ff:fe57:225a ∪ {2001:4ca0:2001:17:225:90ff:fe7a:cbba .. 2001:4ca0:2001:17:225:90ff:fe7a:cbbb}∪ {2001:4ca0:2001:17:225:90ff:fe7a:cbbe .. 2001:4ca0:2001:17:225:90ff:fe7a:cbbf} {2001:4ca0:108:42:: .. 2001:4ca0:108:42::4}∪ {2001:4ca0:108:42::a .. 2001:4ca0:108:42::f}∪ {2001:4ca0:108:42::11 .. 2001:4ca0:108:42:ffff:ffff:ffff:ffff} {2001:4ca0:108:42::5 .. 2001:4ca0:108:42::9} ∪ 2001:4ca0:108:42::10 Fig. 11 Lab IPv6 HTTP Service Matrix (2016) Firewall H. This ruleset from 2003 appears to block Kazaa filesharing traffic during working hours. In addition, a rule drops all packets with the string “X-Kazaa-User”. The more per- missive abstraction correctly tells that the firewall may accept all packets for all IPs (if the above conditions do not hold). Hence, the firewall is essentially abstracted to an allow-all ruleset. According to our metric, this information is not useful. However, in this scenario, this information may reveal an error in the ruleset: the firewall explicitly permits certain IP ranges, but the default policy is Accept and includes all these previously explicitly per- mitted ranges. By inspecting the structure of the firewall, we suspect that the default policy should be Drop. This possible misconfiguration was uncovered by the overapproximation. The underapproximation does not understand the string match on “X-Kazaa-User” in the beginning and thus corresponds to the deny-all ruleset. However, a manual inspection of the underapproximation still reveals an interesting error: the ruleset also tries to prevent MAC address spoofing for some hard-coded MAC/IP pairs. However, we could not see any drop rules for spoofed MAC addresses in the underapproximation. Indeed, the ruleset allows non- spoofed packets but forgets to drop the spoofed ones. This firewall demonstrates the worst case for our approximations: one set of accepted packets is the universe, the other is the empty set. But because this ruleset is severely broken, no better approximation would be possible. Nevertheless, the manual inspection of the simplified ruleset helped reveal several errors. This demonstrates that even if the service matrices do not contain any information, the other output of our tool may still contain interesting information. 123 Verified iptables Firewall Analysis and Verification 235 {0.0.0.0..10.13.36.255}∪ {10.13.38.0..10.13.42.127}∪ {10.13.42.192..10.13.42.255}∪ {10.13.43.32..10.13.43.255}∪ 141.76.2.4 {10.13.45.0..141.76.2.3}∪ {141.76.2.5..255.255.254.25}∪ {255.255.255.1..255.255.255.255} {10.13.43.16..10.13.43.31} {10.13.42.128..10.13.42.175}∪ {10.13.42.176..10.13.42.191} {10.13.43.0..10.13.43.15} {10.13.37.0 .. 10.13.37.255}∪{10.13.44.0 .. 10.13.44.255}∪ 255.255.255.0 Fig. 12 Firewall D SSH service matrix with input and output port rewriting Firewall P. This is the ruleset of the main firewall of a medium-sized company. The admin- istrator asked us what their ruleset was doing. They did not reveal their intentions to prevent analysis results skewed towards the expected outcome. We calculated the simplified firewall rules and service matrices. Using the underapproxi- mation, we could also give guarantees about the packets which are definitely allowed by the firewall. The administrator critically inspected the output of our tool. Finally, they confirmed that the firewall was working exactly as intended. This demonstrates: not only finding errors but showing correctness is one of the key strengths of our tool. After the analysis, the administrator revealed their true intentions. They have previously upgraded the system to iptables. Their users (the company’s employees) became aware of that. They received some complaints about connectivity issues and the employees were blaming the firewall. However, the administrator was suspecting that the connectivity issues were triggered by some users who are behaving against the corporate policy, e.g., sharing user accounts. With the help of our analysis, the administrator could reject all accusations about their firewall configuration and follow their initial suspicion about misbehaving employees. A few months later, we received feedback that the firewall was perfect and “users are stupid”. Firewall R. This ruleset was extracted from a Docker host and partly generated by topoS [21]. For remote management, the ruleset allows unconstrained SSH access for all machines, which can be seen by the fact that the SSH service matrix only shows one partition. In contrast, an advanced setup is enforced for HTTP and the HTTP matrix is visualized in Fig. 13.Being able to verify the publicly exposed HTTP setup while neglecting the SSH maintenance setup 123 236 C. Diekmann et al. {0.0.0.0..9.255.255.255}∪ {11.0.0.0..255.255.255.255} {10.0.0.1, 10.0.0.42} {10.0.0.4} {10.0.0.2} {10.0.0.3} {10.0.0.0}∪{10.0.0.5..10.0.0.41}∪ {10.0.0.43..10.255.255.255} Fig. 13 HTTP service matrix with state of a Docker host demonstrates the advantage of calculating our access matrices for each service. We extended fffuu to also show flows which can be in an ESTABLISHED state. This is visualized by an orange dashed line. Due to special, scenario-specific requirements, we can see that 10.0.0.2 is a true information sink and may not even answer to ESTABLISHED connections. The lower closure also exhibits one interesting detail: except for one host which is rate limited, SSH connectivity is guaranteed. Ironically, ITVal segfaults on the original ruleset. With our processing, it terminates successfully but returns a spurious result. 15 Outlook: Verifying OpenFlow Rules OpenFlow [64,67] is a standard for configuring OpenFlow-enabled switches. It is usually referred to in the context of Software-Defined Networking (SDN) and has been hot topic in network management and operations for almost 10 years. This article focused on the analysis of iptables instead of OpenFlow for several reasons: despite OpenFlow 1.0 [67] having been available for over 5 years, it is a relatively young and not very wide-spread product. In contrast, iptables is battle-tested, real-world approved, supports a large amount of features, and has been in productive use for over a decade. There 123 Verified iptables Firewall Analysis and Verification 237 are also decade-old configurations which utilize a vast amount of features, which are no longer fully understood by administrators [3]. As of July 2016, the popular systems and networking Q&A site Server Fault counts more than a hundred times more questions related to iptables than OpenFlow. The related Super User site counts even a thousand times more questions related to iptables than OpenFlow. Over the years, iptables has evolved into a system with an enormous amount of (legacy) features. Compared to this, OpenFlow is a tidy piece of technology. But we anticipate to see similar feature creep over the years, considering, e.g., Nicira extensions [61] or attempts to enhance OpenFlow with generic FPGAs to add “exotic functionality” [12]. In a broader context, by extending OpenFlow or one of its proposed stateful, more feature-rich, successors [7], many iptables features have already been reimplemented on top of it [65]. Our declared goal was to provide scientific methods to understand challenging config- urations (as observed in iptables) and evaluate our methodology on complex, real-world, legacy-grown systems. The insights we obtained can also be applied to OpenFlow. In par- ticular, a large portion of this article focuses on match conditions, e.g., abstracting over unknowns, optimizing, rewriting, normalizing, or even replacing interfaces by IP addresses. Our work on match conditions can be directly reused in future work within the context of OpenFlow. However, iptables is not OpenFlow. In particular, the OpenFlow standard defines a vast amount of actions which can be performed for a packet. In contrast, iptables filtering primarily uses the two actions Accept and Drop. This is because a firewall cleanly separates filtering from other network functions, such as packet rewriting. OpenFlow implementations tend to mix those. We have shown how to deal with unknown match conditions, but unknown actions are an unsolved problem. We discussed what would be required for a full OpenFlow semantics. In particular, a mutable packet model (cf. Sect. 4.2) would be necessary, which our methods do not support. However, there is no technical need for OpenFlow switches to mix packet filtering with other operations. For example, the pipelined OpenFlow Router architecture constructed by Nelson et al. [57, Sect. 3, Fig. 3] clearly separates packet filtering from packet forwarding and rewriting. In general, using pipeline processing as specified in recent OpenFlow standards [64] might be a step forward to separate filtering from forwarding and rewriting. This may also help compilers which produce OpenFlow rules and suffer from a large blow-up which is induced by a cross product over several tables to join rules for different actions into one table [76]. Such a filtering table implemented by OpenFlow rules without unspecified behavior could be analyzed by our presented methods. In contrast to firewall rules, OpenFlow flow table entries are usually not written by hand, but high-level programming languages (such as NetCore [52], NetKAT [4], or Flowlog [56]) can be used. The overall question arises whether the analysis of low-level OpenFlow rules is necessary, since for example a verified compiler from NetCore to OpenFlow exists [33]. Therefore, the analysis and verification of the high-level programming language may be more interesting than the analysis of generated low-level OpenFlow entries. The Flowlog language was especially designed with built-in verification and analysis in mind [55,58] and NetKAT was explicitly designed as a Kleene Algebra with Tests (KAT) which is suitable for formal analysis and it also features an automated decision procedure [30]. https://serverfault.com/. https://superuser.com/. 123 238 C. Diekmann et al. 16 Conclusion This work was motivated by the fact that we could not find any tool which helped us analyze our lab’s and other firewall rulesets. Though much related work about firewall analysis exists, all academic firewall models are too simplistic to be applicable to those real-world rulesets. With the transformations presented in this article, they became processable by existing tools. We have demonstrated the first fully verified, real-world applicable analysis framework for firewall rulesets. Our tool fffuu supports the Linux iptables firewall because it is widely used and well-known for its vast amount of features. It directly works on iptables-save output. We presented an algebra on common match conditions and a method to translate complex conditions to simpler ones. Further match conditions, which are either unknown or cannot be translated, are approximated in a sound fashion. This results in a translation method for complex, real-world rulesets to a simple model. The evaluation demonstrates that, despite possible approximation, the simplified rulesets preserve the interesting aspects of the original ones. Based on the simplified model, we presented algorithms to partition the IPv4 and IPv6 address space and compute service matrices. This allows summarizing and verifying the firewall in a clear manner. The analysis is fully implemented in the Isabelle theorem prover. No additional input or knowledge of mathematics is required by the administrator. The evaluation demonstrates applicability on many real-world rulesets. For this, to the best of our knowledge, we have collected and published the largest collection of real-world iptables rulesets in academia. We demonstrated that our approach can outperform existing tools with regard to correctness, supported match conditions, CPU time, and memory requirements. Our tool helped to verify lack of errors or, alternatively, to discover previously unknown errors in real-world, production rulesets. 17 Availability Our Isabelle/HOL theory files with the formalization and the referenced correctness proofs and our tool fffuu areavailableat https://github.com/diekmann/Iptables_Semantics It is the first fully machine-verified iptables analysis tool. A stable version of the theory files can also be obtained from the “Archive of Formal Proofs” (AFP) [19,22,24,51]. AFP maintenance policy ensures that our formalization will keep working with newer Isabelle releases. The raw data of the analyzed firewall rulesets can be found at https://github.com/diekmann/net-network To the best of our knowledge, this is the largest, publicly-available collection of real-world iptables firewall rulesets. Acknowledgements We thank the anonymous reviewers for suggesting countless improvements to the paper. A special thanks goes to Andreas Korsten for valuable discussions. We thank the network administrators for contributing and agreeing to publish their firewall configurations. Lars Noschinski contributed proofs to the formalization of the IP address space. Manuel Eberl, Lukas Schwaighofer, and Fabian Immler commented on early drafts of this paper. This work was greatly inspired by Tobias Nipkow’s and Gerwin Klein’s book on semantics in Isabelle [62]. 123 Verified iptables Firewall Analysis and Verification 239 Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 Interna- tional License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. References 1. Al-Shaer, E., Alsaleh, M.: ConfigChecker: a tool for comprehensive security configuration analytics. In: Configuration Analytics and Automation (SAFECONFIG), pp. 1–2. IEEE (2011). https://doi.org/10. 1109/SafeConfig.2011.6111667 2. Al-Shaer, E., Hamed, H.: Discovery of policy anomalies in distributed firewalls. In: Annual Joint Confer- ence of the IEEE Computer and Communications Societies (INFOCOM), vol. 4, pp. 2605–2616 (2004). https://doi.org/10.1109/INFCOM.2004.1354680 3. Analyzed firewall rulesets (raw data). https://github.com/diekmann/net-network. Accompanying material 4. Anderson, C.J., Foster, N., Guha, A., Jeannin, J.B., Kozen, D., Schlesinger, C., Walker, D.: NetKAT: semantic foundations for networks. In: 41st ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages, POPL ’14, pp. 113–126. ACM, San Diego (2014). https://doi.org/10.1145/ 2535838.2535862 5. Baker, F., Savola, P.: Ingress filtering for multihomed networks. RFC 3704 (Best Current Practice) (2004) 6. Bartal, Y., Mayer, A., Nissim, K., Wool, A.: Firmato: a novel firewall management toolkit. In: IEEE Symposium on Security and Privacy, pp. 17–31. IEEE (1999). https://doi.org/10.1109/SECPRI.1999. 7. Bianchi, G., Bonola, M., Capone, A., Cascone, C.: OpenState: programming platform-independent stateful openflow applications inside the switch. ACM SIGCOMM Comput. Commun. Rev. 44(2), 44–51 (2014). https://doi.org/10.1145/2602204.2602211 8. Brucker, A.D., Brügger, L., Kearney, P., Wolff, B.: Verified firewall policy transformations for test case generation. In: 3rd International Conference on Software Testing, Verification and Validation, pp. 345– 354. IEEE (2010). https://doi.org/10.1109/ICST.2010.50 9. Brucker, A.D., Brügger, L., Wolff, B.: Model-based firewall conformance testing. In: Suzuki, K., Higashino, T., Ulrich, A., Hasegawa, T. (eds.) Testing of Software and Communicating Systems, pp. 103–118. Springer (2008) 10. Brucker, A.D., Brügger, L., Wolff, B.: Formal firewall conformance testing: an application of test and proof techniques. Softw. Test. Verif. Reliab. (STVR) 25(1), 34–71 (2015). https://doi.org/10.1002/stvr. 1544, https://www.brucker.ch/bibliography/abstract/brucker.ea-formal-fw-testing-2014 11. Brucker, A.D., Brügger, L., Wolff, B.: Formal network models and their application to firewall policies. Archive of Formal Proofs (2017). http://isa-afp.org/entries/UPF_Firewall.shtml. Formal proof develop- ment 12. Byma, S., Tarafdar, N., Xu, T., Bannazadeh, H., Leon-Garcia, A., Chow, P.: Expanding OpenFlow capabilities with virtualized reconfigurable hardware. In: ACM/SIGDA International Symposium on Field-Programmable Gate Arrays, FPGA ’15, pp. 94–97. ACM, Monterey (2015). https://doi.org/10. 1145/2684746.2689086 13. Capretta, V., Stepien, B., Felty, A., Matwin, S.: Formal correctness of conflict detection for firewalls. In: Workshop on Formal Methods in Security Engineering, pp. 22–30. ACM (2007). https://doi.org/10.1145/ 1314436.1314440 14. Cisco IOS firewall—configuring IP access lists. Document ID: 23602 (2007). http://www.cisco.com/c/ en/us/support/docs/security/ios-firewall/23602-confaccesslists.html 15. Cotton, M., Vegoda, L., Bonica, R., Haberman, B.: Special-purpose IP address registries. RFC 6890 (Best Current Practice) (2013) 16. CrazyCat: iptables multiport and negation. Server Fault Question (2016). http://serverfault.com/questions/ 793631/iptables-multiport-and-negation/ 17. Deering, S., Hinden, R.: Internet protocol, version 6 (IPv6) specification. RFC 2460 (Draft Standard) (1998). Updated by RFCs 5095, 5722, 5871, 6437, 6564, 6935, 6946, 7045, 7112 18. Diekmann, C.: Naming network interfaces. In: PoC||GTFO: Pastor Laphroaig Races the Runtime Relinker and Other True Tales of Cleverness and Craft, vol. 16, no. 08, pp. 45–46 (2017) 19. Diekmann, C., Hupel, L.: Iptables semantics. Archive of Formal Proofs (2016). http://isa-afp.org/entries/ Iptables_Semantics.shtml. Formal proof development 20. Diekmann, C., Hupel, L., Carle, G.: Directed security policies: a stateful network implementation. In: Electronic Proceedings in Theoretical Computer Science on Engineering Safety and Security Systems 123 240 C. Diekmann et al. (ESSS), vol. 150, pp. 20–34. Open Publishing Association, Singapore (2014). https://doi.org/10.4204/ EPTCS.150.3 21. Diekmann, C., Korsten, A., Carle, G.: Demonstrating topoS: theorem-prover-based synthesis of secure network configurations. In: 11th International Conference on Network and Service Management (CNSM), pp. 366–371. Barcelona (2015). https://doi.org/10.1109/CNSM.2015.7367384 22. Diekmann, C., Michaelis, J., Haslbeck, M.: Simple firewall. Archive of Formal Proofs (2016). http://isa- afp.org/entries/Simple_Firewall.shtml. Formal proof development 23. Diekmann, C., Michaelis, J., Haslbeck, M., Carle, G.: Verified iptables firewall analysis. In: IFIP Net- working 2016. Vienna (2016) 24. Diekmann, C., Michaelis, J., Hupel, L.: IP addresses. Archive of Formal Proofs (2016). http://isa-afp. org/entries/IP_Addresses.shtml. Formal proof development 25. Diekmann, C., Posselt, S.A., Niedermayer, H., Kinkelin, H., Hanka, O., Carle, G.: Verifying security policies using host attributes. In: Formal Techniques for Distributed Objects, Components, and Systems: 34th IFIP WG 6.1 International Conference, FORTE, pp. 133–148. Springer, Berlin (2014). https://doi. org/10.1007/978-3-662-43613-4_9 26. Diekmann, C., Schwaighofer, L., Carle, G.: Certifying spoofing-protection of firewalls. In: 11th Inter- national Conference on Network and Service Management (CNSM), pp. 168–172. Barcelona (2015). https://doi.org/10.1109/CNSM.2015.7367354 27. diekmann/Iptables_Semantics: Issue #113—Port numbers belong to a specific protocol. github (2016). https://github.com/diekmann/Iptables_Semantics/issues/113 28. Eastep, T.M.: iptables made ease—shorewall (2014). http://shorewall.net/ 29. Engelhardt, J.: Towards the perfect ruleset (2011). http://inai.de/documents/Perfect_Ruleset.pdf 30. Foster, N., Kozen, D., Milano, M., Silva, A., Thompson, L.: A coalgebraic decision procedure for NetKAT. In: 42nd Annual ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages, POPL ’15, pp. 343–355. ACM, Mumbai (2015). https://doi.org/10.1145/2676726.2677011 31. Fuller, V., Li, T.: Classless inter-domain routing (CIDR): the internet address assignment and aggregation plan. RFC 4632 (Best Current Practice) (2006) 32. Gartenmeister, M.: Iptables vs. Cisco PIX (2005). http://lists.netfilter.org/pipermail/netfilter/2005-April/ 059714.html 33. Guha, A., Reitblatt, M., Foster, N.: Machine-verified network controllers. In: 34th ACM SIGPLAN Conference on Programming Language Design and Implementation, PLDI ’13, pp. 483–494. ACM, Seattle (2013). https://doi.org/10.1145/2462156.2462178 34. Haftmann, F., Bulwahn, L.: Code generation from Isabelle/HOL theories (2016) 35. Haftmann, F., Nipkow, T.: Code generation via higher-order rewrite systems. In: Blume, M., Kobayashi, N., Vidal, G. (eds.) Functional and Logic Programming, pp. 103–117. Springer (2010) 36. Hamed, H., Al-Shaer, E.: Taxonomy of conflicts in network security policies. IEEE Commun. Mag. 44(3), 134–141 (2006). https://doi.org/10.1109/MCOM.2006.1607877 37. Hewlett Packard: IP firewall configuration guide (2005). ftp://ftp.hp.com/pub/networking/software/ ProCurve-SR-IP-Firewall-Config-Guide.pdf 38. IPTables Example Config. http://networking.ringofsaturn.com/Unix/iptables.php. Retrieved Sept 2014 39. Jeffrey, A., Samak, T.: Model checking firewall policy configurations. In: Policies for Distributed Systems and Networks, pp. 60–67. IEEE (2009). https://doi.org/10.1109/POLICY.2009.32 40. Kawamura, S., Kawashima, M.: A recommendation for IPv6 address text representation. RFC 5952 (Proposed Standard) (2010) 41. Kazemian, P., Varghese, G., McKeown, N.: Header space analysis: static checking for networks. In: 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI), NSDI’12, pp. 113–126. USENIX Association, San Jose (2012) 42. Kleene, S.C.: Introduction to Metamathematics. Bibliotheca Mathematica. North-Holland, Amsterdam (1952) 43. Lammich, P.: Automatic Data Refinement, pp. 84–99. Springer, Berlin (2013). https://doi.org/10.1007/ 978-3-642-39634-2_9 44. Lammich, P., Tuerk, T.: Applying Data Refinement for Monadic Programs to Hopcroft’s Algorithm, pp. 166–182. Springer, Berlin (2012). https://doi.org/10.1007/978-3-642-32347-8_12 45. Leblond, E.: Why you will love nftables (2014). https://home.regit.org/2014/01/why-you-will-love- nftables/ 46. Linux Kernel Sources: Linux/include/linux/netfilter/x_tables.h. Kernel 4.6. http://lxr.free-electrons.com/ source/include/linux/netfilter/x_tables.h?v=4.6#L343 47. Mansmann, F., Göbel, T., Cheswick, W.: Visual analysis of complex firewall configurations. In: 9th International Symposium on Visualization for Cyber Security, VizSec ’12, pp. 1–8. ACM (2012). https:// doi.org/10.1145/2379690.2379691 123 Verified iptables Firewall Analysis and Verification 241 48. Marmorstein, R.M., Kearns, P.: A tool for automated iptables firewall analysis. In: USENIX Annual Technical Conference, FREENIX Track, pp. 71–81. USENIX Association (2005) 49. Marmorstein, R.M., Kearns, P., et al.: Firewall analysis with policy-based host classification. In: 20th USENIX Large Installation System Administration Conference (LISA), vol. 6. USENIX Association, Washington (2006) 50. Michaelis, J., Diekmann, C.: LOFT—verified migration of Linux firewalls to SDN. Archive of Formal Proofs (2016). http://isa-afp.org/entries/LOFT.shtml. Formal proof development 51. Michaelis, J., Diekmann, C.: Routing. Archive of Formal Proofs (2016). http://isa-afp.org/entries/ Routing.shtml. Formal proof development 52. Monsanto, C., Foster, N., Harrison, R., Walker, D.: A compiler and run-time system for network program- ming languages. In: 39th Annual ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages, POPL ’12, pp. 217–230. ACM (2012) 53. Moy, E., Gildea, S., Dickey, T.: XTerm control sequences (2016). http://invisible-island.net/xterm/ctlseqs/ ctlseqs.html 54. Nelson, T., Barratt, C., Dougherty, D.J., Fisler, K., Krishnamurthi, S.: The Margrave tool for firewall analysis. In: 24th USENIX Large Installation System Administration Conference (LISA). USENIX Asso- ciation, San Jose (2010) 55. Nelson, T., Ferguson, A.D., Krishnamurthi, S.: Static Differential Program Analysis for Software-Defined Networks, pp. 395–413. Springer, Berlin (2015). https://doi.org/10.1007/978-3-319-19249-9_25 56. Nelson, T., Ferguson, A.D., Scheer, M.J., Krishnamurthi, S.: Tierless programming and reasoning for software-defined networks. In: 11th USENIX Symposium on Networked Systems Design and Implemen- tation (NSDI), NSDI’14, pp. 519–531. USENIX Association, Seattle (2014) 57. Nelson, T., Ferguson, A.D., Yu, D., Fonseca, R., Krishnamurthi, S.: Exodus: toward automatic migration of enterprise network configurations to SDNs. In: 1st ACM SIGCOMM Symposium on Software Defined Networking Research, no. 13 in SOSR ’15, pp. 13:1–13:7. ACM, Santa Clara (2015). https://doi.org/10. 1145/2774993.2774997 58. Nelson, T., Guha, A., Dougherty, D.J., Fisler, K., Krishnamurthi, S.: A balance of power: expressive, analyzable controller programming. In: Second ACM SIGCOMM Workshop on Hot Topics in Soft- ware Defined Networking, HotSDN ’13, pp. 79–84. ACM, Hong Kong (2013). https://doi.org/10.1145/ 2491185.2491201 59. NetCitadel, Inc.: FirewallBuilder. http://www.fwbuilder.org.Ver.5.1 60. netfilter coreteam: libxtables/xtables.c. https://git.netfilter.org/iptables/tree/libxtables/xtables.c?h=v1.6. 0#n518 61. Nicira, Inc.: Nicira extensions. openvswitch/ovs repository (2016). https://github.com/openvswitch/ovs/ blob/master/include/openflow/nicira-ext.h. Revision fb8f22c186b89cd36059c37908f940a1aa5e1569 62. Nipkow, T., Klein, G.: Concrete Semantics. Springer, Berlin (2014). https://doi.org/10.1007/978-3-319- 10542-0 63. Nipkow, T., Paulson, L.C., Wenzel, M.: Isabelle/HOL: a proof assistant for higher-order logic. In: LNCS, vol. 2283. Springer (2002, last updated 2016). http://isabelle.in.tum.de/ 64. Nygren, A., Pfaff, B., Lantz, B., Heller, B., Barker, C., Beckmann, C., Cohn, D., Malek, D., Talayco, D., Erickson, D., McDysan, D., Ward, D., Crabbe, E., Schneider, F., Gibb, G., Appenzeller, G., Tourrilhes, J., Tonsing, J., Pettit, J., Yap, K., Poutievski, L., Dunbar, L., Vicisano, L., Casado, M., Takahashi, M., Kobayashi, M., Orr, M., Yadav, N., McKeown, N., dHeureuse, N., Balland, P., Mad- abushi, R., Ramanathan, R., Price, R., Sherwood, R., Das, S., Gandham, S., Curtis, S., Natarajan, S., Mizrahi, T., Yabe, T., Ding, W., Yiakoumis, Y., Moses, Y., Kis, Z.L.: OpenFlow switch speci- fication v1.5.1 (2015). https://www.opennetworking.org/images/stories/downloads/sdn-resources/onf- specifications/openflow/openflow-switch-v1.5.1.pdf.ONFTS-025 65. Petrucci, L., Bonelli, N., Bonola, M., Procissi, G., Cascone, C., Sanvito, D., Pontarelli, S., Bianchi, G., Bifulco, R.: Towards a stateful forwarding abstraction to implement scalable network functions in software and hardware. ArXiv e-prints (2016) 66. PF: the OpenBSD packet filter. http://www.openbsd.org/faq/pf/ 67. Pfaff, B., Heller, B., Talayco, D., Erickson, D., Gibb, G., Appenzeller, G., Tourrilhes, J., Pettit, J., Yap, K., Casado, M., Kobayashi, M., McKeown, N., Balland, P., Price, R., Sherwood, R., Yiakoumis, Y.: OpenFlow switch specification v1.0.0 (2009). http://archive.openflow.org/documents/openflow-spec-v1.0.0.pdf 68. Postel, J.: Internet protocol. RFC 791 (INTERNET STANDARD) (1981). Updated by RFCs 1349, 2474, 69. Pozo, S., Ceballos, R., Gasca, R.M.: CSP-based firewall rule set diagnosis using security policies. In: 2nd International Conference on Availability, Reliability and Security (ARES), pp. 723–729. IEEE, Los Alamitos (2007). https://doi.org/10.1109/ARES.2007.63 123 242 C. Diekmann et al. 70. Pozo, S., Ceballos, R., Gasca, R.M.: Model-based development of firewall rule sets: diagnosing model inconsistencies. Inf. Softw. Technol. 51(5), 894–915 (2009) 71. Renard, B.: cisco-acl-to-iptables (2013). http://git.zionetrix.net/?a=summary&p=cisco-acl-to-iptables. Retrieved Sept 2014 72. Reynolds, J.: Assigned numbers: RFC 1700 is replaced by an on-line database. RFC 3232 (Informational) (2002) 73. Reynolds, J., Postel, J.: Assigned numbers. RFC 1700 (Historic) (1994). Obsoleted by RFC 3232 74. Sherry, J., Hasan, S., Scott, C., Krishnamurthy, A., Ratnasamy, S., Sekar, V.: Making middleboxes someone elses problem: network processing as a cloud service. ACM SIGCOMM Comput. Commun. Rev. 42(4), 13–24 (2012) 75. Sluizer, S., Postel, J.: Mail transfer protocol. RFC 780 (1981). Obsoleted by RFC 788 76. Smolka, S., Eliopoulos, S.A., Foster, N., Guha, A.: A fast compiler for NetKAT. In: International Confer- ence on Functional Programming (ICFP), pp. 328–341. ACM (2015). https://doi.org/10.1145/2784731. 77. Tantau, T., Feuersaenger, C.: The TikZ and pgf packages (2016). Pgfversion 3.0.1a 78. The netfilter.org project: netfilter/iptables project. http://www.netfilter.org/ 79. The netfilter.org project: netfilter/nftables project. http://www.netfilter.org/ 80. Tongaonkar, A., Inamdar, N., Sekar, R.: Inferring higher level policies from firewall rules. In: 21st USENIX Large Installation System Administration Conference (LISA), vol. 7, pp. 1–10. USENIX Association, Dallas (2007) 81. Verizon Business RISK Team, United States Secret Service: 2010 Data Breach Investigations Report (2010). http://www.verizonenterprise.com/resources/reports/rp_2010-DBIR-combined-reports_en_xg. pdf 82. Wool, A.: A quantitative study of firewall configuration errors. IEEE Comput. 37(6), 62–67 (2004) 83. Wool, A.: The use and usability of direction-based filtering in firewalls. Comput. Secur. 23(6), 459–468 (2004) 84. Wool, A.: Trends in firewall configuration errors: measuring the holes in swiss cheese. IEEE Internet Comput. 14(4), 58–65 (2010). https://doi.org/10.1109/MIC.2010.29 85. Yuan, L., Chen, H., Mai, J., Chuah, C.N., Su, Z., Mohapatra, P.: FIREMAN: a toolkit for firewall modeling and analysis. In: IEEE Symposium on Security and Privacy, pp. 199–213 (2006) 86. Zhang, B., Al-Shaer, E., Jagadeesan, R., Riely, J., Pitcher, C.: Specifications of a high-level conflict-free firewall policy language for multi-domain networks. In: 12th ACM Symposium on Access Control Models and Technologies, SACMAT’07, pp. 185–194. ACM (2007). https://doi.org/10.1145/1266840.1266871 87. Zhang, S., Mahmoud, A., Malik, S., Narain, S.: Verification and synthesis of firewalls using SAT and QBF. In: Network Protocols (ICNP), pp. 1–6 (2012). https://doi.org/10.1109/ICNP.2012.6459944

Journal

Journal of Automated ReasoningSpringer Journals

Published: Jan 3, 2018

References

You’re reading a free preview. Subscribe to read the entire article.


DeepDyve is your
personal research library

It’s your single place to instantly
discover and read the research
that matters to you.

Enjoy affordable access to
over 18 million articles from more than
15,000 peer-reviewed journals.

All for just $49/month

Explore the DeepDyve Library

Search

Query the DeepDyve database, plus search all of PubMed and Google Scholar seamlessly

Organize

Save any article or search result from DeepDyve, PubMed, and Google Scholar... all in one place.

Access

Get unlimited, online access to over 18 million full-text articles from more than 15,000 scientific journals.

Your journals are on DeepDyve

Read from thousands of the leading scholarly journals from SpringerNature, Elsevier, Wiley-Blackwell, Oxford University Press and more.

All the latest content is available, no embargo periods.

See the journals in your area

DeepDyve

Freelancer

DeepDyve

Pro

Price

FREE

$49/month
$360/year

Save searches from
Google Scholar,
PubMed

Create lists to
organize your research

Export lists, citations

Read DeepDyve articles

Abstract access only

Unlimited access to over
18 million full-text articles

Print

20 pages / month

PDF Discount

20% off