Reference library
Foundations
Explore concepts, laws, equations and methods, with clear explanations of their use and sources. Choose an area of study or find a specific entry.
More filters
Computation & complexity
Showing 1–30 of 40 reference entries
Build an inspectable physics record, test and revise a bounded cart model, preserve processing history, and plan findable data with appropriate sharing conditions.
MethodInformation · Mathematics & logicBits and unsigned binary encodingA bit has two possible states; a fixed-width unsigned binary word encodes an integer.
DefinitionInformation · Mathematics & logicShannon entropy of a discrete distributionShannon entropy measures uncertainty in a specified probability distribution.
DefinitionInformationAlgorithm and decision procedureAn algorithm specifies effective steps; a decision procedure must terminate on every permitted input.
MethodInformation · Mathematics & logicUndecidability of the halting problemNo total algorithm decides halting for every program and input in a general computation model.
Mathematical statementInformation · Mathematics & logicAsymptotic upper bounds and big OBig O bounds eventual growth up to a fixed constant factor.
DefinitionInformationDeterministic finite automataA DFA consists of finite states Q, finite alphabet Σ, total transition δ:Q×Σ→Q, start q₀ and accepting states F.
DefinitionInformationRegular expressions and NFA equivalenceRegular expressions built from letters, the empty word and empty language using union, concatenation and star describe exactly the DFA/NFA-recognizable languages.
Mathematical statementInformationContext-free grammarsA context-free grammar has finite variables, terminal alphabet, rules A→w with one variable on the left, and a start variable.
DefinitionInformationPushdown automata and context-free languagesA nondeterministic pushdown automaton augments finite control with one unbounded last-in-first-out stack.
Mathematical statementInformationRecognizability versus decidabilityA recognizer accepts every member of its language but may run forever on a nonmember.
DefinitionInformationRice's theorem for language propertiesEvery nontrivial property of the language recognized by a Turing machine is undecidable from its machine description.
Mathematical statementInformationTheta and lower asymptotic boundsFor eventually nonnegative costs f,g, f=Θ(g) means c₁g(n)≤f(n)≤c₂g(n) for all sufficiently large n and constants c₁,c₂>0.
DefinitionInformationPotential-method amortized costIf operation i changes state Dᵢ₋₁ to Dᵢ, define ĉᵢ=cᵢ+Φ(Dᵢ)−Φ(Dᵢ₋₁).
MethodInformation3SAT to CLIQUE reductionFor a 3CNF formula with m clauses, make a vertex for each literal occurrence.
MethodInformationMultitape simulation and model equivalenceA fixed finite-tape deterministic Turing machine running in time t(n)≥n can be simulated by a single-tape machine in O(t(n)²) time by storing tape contents and head markers and scanning them for each simulated step.
Mathematical statementInformationTime, space and encoded input sizeA deterministic decider's time cost counts steps and its space cost counts used storage cells; worst-case bounds maximize over inputs of the same encoded length.
DefinitionInformationRegular-language pumping lemmaIf a language is regular, some p≥1 ensures every accepted word x with |x|≥p decomposes as uvw with |uv|≤p, |v|≥1 and uvᵐw accepted for all m≥0.
Mathematical statementInformationNonregular equal-block languageThe language {0ⁿ1ⁿ:n≥0} is not regular.
MethodInformationFinite-automaton decision proceduresA DFA's language is empty iff no accepting state is reachable from its start.
MethodInformationContext-free membership and emptinessA finite context-free grammar has decidable membership: convert to Chomsky normal form and enumerate bounded derivations for a nonempty input word.
MethodInformationEarley chart parsingFor a finite CFG, chart Iⱼ stores dotted productions [A→β·γ,k], where k is the starting position.
MethodInformationMaster theorem for divide-and-conquer recurrencesFor T(n)=aT(n/b)+f(n), T(1)=Θ(1), let q=log_b a.
Mathematical statementInformationLogarithmic and polynomial space classesDSPACE(s(n)) and NSPACE(s(n)) contain decision languages solvable with O(s(n)) workspace by deterministic and nondeterministic Turing machines.
DefinitionInformationConstructible resource boundsA time bound t(n)≥n is time constructible here when a Turing machine on unary input 1ⁿ can write 1ᵗ⁽ⁿ⁾ in O(t(n)) time.
DefinitionInformationSavitch deterministic space simulationFor a space-constructible s(n)≥log n, NSPACE(s(n))⊆DSPACE(s(n)²).
Mathematical statementInformationLogspace reductions and directed reachabilityA logspace many-one reduction computes f with x∈A exactly when f(x)∈B, using a read-only input, O(log n) work tape and write-only output.
Mathematical statementInformationNL complement closureNL=coNL: complements of nondeterministic logspace decision languages also lie in NL.
Mathematical statementInformationDeterministic time hierarchyFor time-constructible f,g≥n with f(n)log f(n)=o(g(n)), DTIME(f(n)) is a proper subset of DTIME(g(n)).
Mathematical statementInformationDeterministic space hierarchyIf S is space constructible, S(n)≥n, and s(n)=o(S(n)), then DSPACE(s(n))⊊DSPACE(S(n)).
Mathematical statement