Participation by NIST in the creation of the documentation of mentioned software is not intended to imply a recommendation or endorsement by the National Institute of Standards and Technology, nor is it intended to imply that any specific software is necessarily the best available for the purpose.
Background
UCO Issue 583 proposed several revisions around representations pertaining to software and its configuration.
This Issue focuses on one set of changes pertaining to a restructure of the class hierarchy pertaining to software, so some changes from 583 can be discussed and implemented for UCO 1.4.0.
Requirements
Requirement 583-2
This requirement is ported from Issue 583:
Ability to characterize different types of software objects
At a minimum this should include Software, Code, Application, Script, Library, Package, Process, Compiler, BuildUtility, SoftwareBuild, OperatingSystem, and ServicePack.
Risk / Benefit analysis
Benefits
This benefit is ported from Issue 583:
Clarity and consistency of different forms of software observable objects
Risks
These risks are in addition to those listed on Issue 583.
The rdfs:comment definition of ProcessThread does not seem entirely coherent with ProcessThread being a subclass of Process. This software overhaul provides an opportunity for clarification.
It is unclear whether any observable:Software subclasses should be considered disjoint with other observable:Software subclasses. The rich and adaptive behavioral nature of software might make it impractical to designate any of these classes disjoint.
The new class observable:Package has some usage modes where it is an observable:File and where it is not. Take for example the wheel distribution (URL ending .whl) of case-utils, as listed here. The .whl file that was prepared for upload could be considered both an observable:Package, because it is an installable artifact, and observable:File, because it's a file on the build system's file system. However, the object on PyPI might not be classifiable as an observable:File.
The file-or-not point is a point for debate somewhat out of scope of this proposal. UCO models File as a subclass of FileSystemObject. PyPI, and other package management ecosystems, might not store blobs like this as files. They're free to store the backing contents of these URLs as blobs in relational database tables or NoSQL stores if they wanted to. But this is generally invisible to the package consumer.
Competencies demonstrated
(For the sake of discusssion, these examples avoid the UCO rule ending IRIs with UUIDs.)
Competency 1
On a laptop, a directory contains a lone, regular file that contains Python code.
#!/usr/bin/env python3
print("Hello, world!")
The SHA3-256 hash of this file's contents is 496e34e7fe23cf69f078cd1fe860b98b2e91101194773b2f144656c0bab877c3.
This below snippet characterizes this Python file with concepts predating this restructuring proposal: There is a File; separately there is a ContentData; and last there is a Relationship stating that the File contains that ContentData, for all times that the Relationship holds. (Let's assume the Relationship still holds.)
Note: This demonstration purposefully avoids attaching a ContentDataFacet directly to the File.
Which objects, between the File, ContentData and ObservableRelationship, are classified as, or constitute, the following?
observable:Application
observable:Code
observable:Script
Result 1.1
TODO
Competency 2
An Ubuntu server runs a service called mywebapp. Running the command service mywebapp status reports three tasks associated with the service. The primary task has PID 10001, and two other worker tasks have PIDs 10002 and 10003. A graph containing these objects contains at least the following:
kb:Process-10001
a
observable:LinuxService ,
observable:LinuxTask
;
core:hasFacet kb:ProcessFacet-1 ;
.
kb:ProcessFacet-1
a observable:ProcessFacet ;
observable:pid 10001 ;
.
kb:Process-10002
a observable:LinuxTask ;
core:hasFacet kb:ProcessFacet-2 ;
.
kb:ProcessFacet-2
a observable:ProcessFacet ;
observable:parent kb:Process-10001 ;
observable:pid 10002 ;
.
kb:Process-10003
a observable:LinuxTask ;
core:hasFacet kb:ProcessFacet-3 ;
.
kb:ProcessFacet-3
a observable:ProcessFacet ;
observable:parent kb:Process-10001 ;
observable:pid 10003 ;
.
(NOTE: observable:parent might require a revision to its modeling, due to the potential for processes to become daemons, orphans, zombies - each of which severs the original parent link. The community should consider this an invitation to propose updating practices pertaining to observable:parent, and whether deprecation is appropriate.)
Competency Question 2.1
Which objects are classified as observable:Tasks?
SELECT ?nTask
WHERE {
?nTask a/rdfs:subClassOf* observable:Task ;
}
Result 2.1
kb:Process-10001
kb:Process-10002
kb:Process-10003
Competency Question 2.2
Which objects are classified as observable:Services?
SELECT ?nService
WHERE {
?nService a/rdfs:subClassOf* observable:Service ;
}
Result 2.2
kb:Process-10001
Competency Question 2.3
Which processes are, or were, currently non-primary tasks for the service kb:Process-10001? If the process was a task, when is the relationship known to have ended?
Note this requires terminable parent-child relationship objects; and also, this example applies a custom string for core:kindOfRelationship. (Another proposal about strongly-typed ObservableRelationships linking child processes to parents would complement this example well.)
To motivate modeling terminable relationships, consider this extra example data, which includes a representation that some process was spawned and became detached from the website service:
Then, the query portion pertaining to detached processes would show a process that left home for the holiday:
?nTask
?lEndTime
kb:Process-10002
kb:Process-10003
kb:Process-10987
2023-12-25T08:14:15.9Z
Solution suggestion
This diagram is ported from Issue 583's solution suggestion:
Since the initial implementation sketch of Issue 583, the following changes have been made:
observable:LinuxService, a subclass of observable:Service and sibling to observable:WindowsService, has been added.
Issue 583 included some subclass rearrangement that would not be considered a backwards-compatible change. For existing classes that will change their position in the subclass hierarchy, shapes are added for UCO 1.4.0, to warn users their current instances should be multi-typed to line up with what will be the parents in UCO 2.0.0.
Disclaimer
Participation by NIST in the creation of the documentation of mentioned software is not intended to imply a recommendation or endorsement by the National Institute of Standards and Technology, nor is it intended to imply that any specific software is necessarily the best available for the purpose.
Background
UCO Issue 583 proposed several revisions around representations pertaining to software and its configuration.
This Issue focuses on one set of changes pertaining to a restructure of the class hierarchy pertaining to software, so some changes from 583 can be discussed and implemented for UCO 1.4.0.
Requirements
Requirement 583-2
This requirement is ported from Issue 583:
Risk / Benefit analysis
Benefits
This benefit is ported from Issue 583:
Risks
These risks are in addition to those listed on Issue 583.
rdfs:comment
definition ofProcessThread
does not seem entirely coherent withProcessThread
being a subclass ofProcess
. This software overhaul provides an opportunity for clarification.observable:Software
subclasses should be considered disjoint with otherobservable:Software
subclasses. The rich and adaptive behavioral nature of software might make it impractical to designate any of these classes disjoint.observable:Package
has some usage modes where it is anobservable:File
and where it is not. Take for example the wheel distribution (URL ending.whl
) ofcase-utils
, as listed here. The.whl
file that was prepared for upload could be considered both anobservable:Package
, because it is an installable artifact, andobservable:File
, because it's a file on the build system's file system. However, the object on PyPI might not be classifiable as anobservable:File
.File
as a subclass ofFileSystemObject
. PyPI, and other package management ecosystems, might not store blobs like this as files. They're free to store the backing contents of these URLs as blobs in relational database tables or NoSQL stores if they wanted to. But this is generally invisible to the package consumer.Competencies demonstrated
(For the sake of discusssion, these examples avoid the UCO rule ending IRIs with UUIDs.)
Competency 1
On a laptop, a directory contains a lone, regular file that contains Python code.
The SHA3-256 hash of this file's contents is
496e34e7fe23cf69f078cd1fe860b98b2e91101194773b2f144656c0bab877c3
.This below snippet characterizes this Python file with concepts predating this restructuring proposal: There is a
File
; separately there is aContentData
; and last there is aRelationship
stating that theFile
contains thatContentData
, for all times that theRelationship
holds. (Let's assume theRelationship
still holds.)Note: This demonstration purposefully avoids attaching a
ContentDataFacet
directly to theFile
.Competency Question 1.1
Which objects, between the
File
,ContentData
andObservableRelationship
, are classified as, or constitute, the following?observable:Application
observable:Code
observable:Script
Result 1.1
TODO
Competency 2
An Ubuntu server runs a service called
mywebapp
. Running the commandservice mywebapp status
reports three tasks associated with the service. The primary task has PID 10001, and two other worker tasks have PIDs 10002 and 10003. A graph containing these objects contains at least the following:(NOTE:
observable:parent
might require a revision to its modeling, due to the potential for processes to become daemons, orphans, zombies - each of which severs the original parent link. The community should consider this an invitation to propose updating practices pertaining toobservable:parent
, and whether deprecation is appropriate.)Competency Question 2.1
Which objects are classified as
observable:Task
s?Result 2.1
kb:Process-10001
kb:Process-10002
kb:Process-10003
Competency Question 2.2
Which objects are classified as
observable:Service
s?Result 2.2
kb:Process-10001
Competency Question 2.3
Which processes are, or were, currently non-primary tasks for the service
kb:Process-10001
? If the process was a task, when is the relationship known to have ended?Note this requires terminable parent-child relationship objects; and also, this example applies a custom string for
core:kindOfRelationship
. (Another proposal about strongly-typedObservableRelationship
s linking child processes to parents would complement this example well.)Result 2.3
Assume that the example is modified to remove these statements (which removes reliance on the mutative
observable:pid
property) ...... and to add these instead:
To motivate modeling terminable relationships, consider this extra example data, which includes a representation that some process was spawned and became detached from the website service:
Then, the query portion pertaining to detached processes would show a process that left home for the holiday:
kb:Process-10002
kb:Process-10003
kb:Process-10987
2023-12-25T08:14:15.9Z
Solution suggestion
This diagram is ported from Issue 583's solution suggestion:
Since the initial implementation sketch of Issue 583, the following changes have been made:
observable:LinuxService
, a subclass ofobservable:Service
and sibling toobservable:WindowsService
, has been added.Coordination