GLOBAL KNOWLEDGE ARK

Reference library

Foundations

Explore concepts, laws, equations and methods, with clear explanations of their use and sources. Choose an area of study or find a specific entry.

More filters

Computation & complexity

Showing 1–30 of 40 reference entries

Physics · Information · MeasurementScientific records

Build an inspectable physics record, test and revise a bounded cart model, preserve processing history, and plan findable data with appropriate sharing conditions.

Method
Information · Mathematics & logicBits and unsigned binary encoding

A bit has two possible states; a fixed-width unsigned binary word encodes an integer.

Definition
Information · Mathematics & logicShannon entropy of a discrete distribution

Shannon entropy measures uncertainty in a specified probability distribution.

Definition
InformationAlgorithm and decision procedure

An algorithm specifies effective steps; a decision procedure must terminate on every permitted input.

Method
Information · Mathematics & logicUndecidability of the halting problem

No total algorithm decides halting for every program and input in a general computation model.

Mathematical statement
Information · Mathematics & logicAsymptotic upper bounds and big O

Big O bounds eventual growth up to a fixed constant factor.

Definition
InformationDeterministic finite automata

A DFA consists of finite states Q, finite alphabet Σ, total transition δ:Q×Σ→Q, start q₀ and accepting states F.

Definition
InformationRegular expressions and NFA equivalence

Regular expressions built from letters, the empty word and empty language using union, concatenation and star describe exactly the DFA/NFA-recognizable languages.

Mathematical statement
InformationContext-free grammars

A context-free grammar has finite variables, terminal alphabet, rules A→w with one variable on the left, and a start variable.

Definition
InformationPushdown automata and context-free languages

A nondeterministic pushdown automaton augments finite control with one unbounded last-in-first-out stack.

Mathematical statement
InformationRecognizability versus decidability

A recognizer accepts every member of its language but may run forever on a nonmember.

Definition
InformationRice's theorem for language properties

Every nontrivial property of the language recognized by a Turing machine is undecidable from its machine description.

Mathematical statement
InformationTheta and lower asymptotic bounds

For eventually nonnegative costs f,g, f=Θ(g) means c₁g(n)≤f(n)≤c₂g(n) for all sufficiently large n and constants c₁,c₂>0.

Definition
InformationPotential-method amortized cost

If operation i changes state Dᵢ₋₁ to Dᵢ, define ĉᵢ=cᵢ+Φ(Dᵢ)−Φ(Dᵢ₋₁).

Method
Information3SAT to CLIQUE reduction

For a 3CNF formula with m clauses, make a vertex for each literal occurrence.

Method
InformationMultitape simulation and model equivalence

A fixed finite-tape deterministic Turing machine running in time t(n)≥n can be simulated by a single-tape machine in O(t(n)²) time by storing tape contents and head markers and scanning them for each simulated step.

Mathematical statement
InformationTime, space and encoded input size

A deterministic decider's time cost counts steps and its space cost counts used storage cells; worst-case bounds maximize over inputs of the same encoded length.

Definition
InformationRegular-language pumping lemma

If a language is regular, some p≥1 ensures every accepted word x with |x|≥p decomposes as uvw with |uv|≤p, |v|≥1 and uvᵐw accepted for all m≥0.

Mathematical statement
InformationNonregular equal-block language

The language {0ⁿ1ⁿ:n≥0} is not regular.

Method
InformationFinite-automaton decision procedures

A DFA's language is empty iff no accepting state is reachable from its start.

Method
InformationContext-free membership and emptiness

A finite context-free grammar has decidable membership: convert to Chomsky normal form and enumerate bounded derivations for a nonempty input word.

Method
InformationEarley chart parsing

For a finite CFG, chart Iⱼ stores dotted productions [A→β·γ,k], where k is the starting position.

Method
InformationMaster theorem for divide-and-conquer recurrences

For T(n)=aT(n/b)+f(n), T(1)=Θ(1), let q=log_b a.

Mathematical statement
InformationLogarithmic and polynomial space classes

DSPACE(s(n)) and NSPACE(s(n)) contain decision languages solvable with O(s(n)) workspace by deterministic and nondeterministic Turing machines.

Definition
InformationConstructible resource bounds

A time bound t(n)≥n is time constructible here when a Turing machine on unary input 1ⁿ can write 1ᵗ⁽ⁿ⁾ in O(t(n)) time.

Definition
InformationSavitch deterministic space simulation

For a space-constructible s(n)≥log n, NSPACE(s(n))⊆DSPACE(s(n)²).

Mathematical statement
InformationLogspace reductions and directed reachability

A logspace many-one reduction computes f with x∈A exactly when f(x)∈B, using a read-only input, O(log n) work tape and write-only output.

Mathematical statement
InformationNL complement closure

NL=coNL: complements of nondeterministic logspace decision languages also lie in NL.

Mathematical statement
InformationDeterministic time hierarchy

For time-constructible f,g≥n with f(n)log f(n)=o(g(n)), DTIME(f(n)) is a proper subset of DTIME(g(n)).

Mathematical statement
InformationDeterministic space hierarchy

If S is space constructible, S(n)≥n, and s(n)=o(S(n)), then DSPACE(s(n))⊊DSPACE(S(n)).

Mathematical statement