talksik/mediapipe
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,727 Commits 9 Branches 53 Tags
dfc604f50009c04f2eb2344945d64287c63daa77
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Jiuqiang TangandCopybara-Service e6bb9e29c0 Internal change 
PiperOrigin-RevId: 524317439
 2023-04-14 10:01:01 -07:00
Jiuqiang TangandCopybara-Service 8cedb82df1 Expose face stylizer and interactive segmenter to be public mediapipe python API. 
PiperOrigin-RevId: 522654239
 2023-04-07 12:12:49 -07:00
Jiuqiang TangandCopybara-Service bca0a92c2e Add FaceToRectCalculator. 
PiperOrigin-RevId: 522595752
 2023-04-07 07:44:51 -07:00
jqtang 3c05df9c46 Merge pull request #4235 from priankakariatyml:ios-object-detection-containers 
PiperOrigin-RevId: 521553151
 2023-04-03 15:12:06 -07:00
Jiuqiang TangandCopybara-Service 7f9fd4f154 Add the minimum version number requirement to sounddevice in requirements.txt. 
PiperOrigin-RevId: 520998845
 2023-03-31 13:27:42 -07:00
Jiuqiang TangandCopybara-Service 508c72ddc9 Internal changes 
PiperOrigin-RevId: 520775988
 2023-03-30 16:45:34 -07:00
Jiuqiang TangandCopybara-Service 984073bf73 Fix the "'<>' with anonymous inner classes is not supported" error. 
PiperOrigin-RevId: 520705926
 2023-03-30 12:05:08 -07:00
Jiuqiang TangandCopybara-Service 1e77725a15 Add necessary java lite proto source code to mediapipe tasks aar for the face landmarker task. 
PiperOrigin-RevId: 520143851
 2023-03-28 15:01:50 -07:00
Jiuqiang TangandCopybara-Service bda2639376 Switch to use the isPresent() API since the isEmpty() is only available since java 11: https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/util/Optional.html#isEmpty(). 
PiperOrigin-RevId: 520099308
 2023-03-28 12:20:55 -07:00
Jiuqiang TangandCopybara-Service d4ec485971 Add face landmarker and face geometry java lite proto source code into mediapipe tasks AAR. 
PiperOrigin-RevId: 520049667
 2023-03-28 09:29:45 -07:00
Jiuqiang TangandCopybara-Service 94db96fa5e Add MatrixDataProto.java to mediapipe aar. 
PiperOrigin-RevId: 519925872
 2023-03-27 22:22:17 -07:00
Jiuqiang TangandCopybara-Service c3b4fa5627 Expose face detector and face landmarker as public MediaPipe Tasks Python API. 
PiperOrigin-RevId: 519822084
 2023-03-27 14:03:21 -07:00
Jiuqiang TangandCopybara-Service 55b9bd9d5e Internal change 
PiperOrigin-RevId: 519224694
 2023-03-24 13:33:47 -07:00
Jiuqiang TangandCopybara-Service d6256362ec Internal change 
PiperOrigin-RevId: 519186057
 2023-03-24 10:56:50 -07:00
Jiuqiang TangandCopybara-Service 21e0ff3d4e Skip unnecessary cpu<->gpu conversion if the input and output are already on the same storage. 
PiperOrigin-RevId: 518573284
 2023-03-22 08:22:38 -07:00
Jiuqiang TangandCopybara-Service b71e1d14d3 Add missing dependency library targets to mediapipe_task_aar. 
PiperOrigin-RevId: 518384666
 2023-03-21 14:38:11 -07:00
Jiuqiang TangandCopybara-Service 384f77b5c3 Fix the proto src file names. 
PiperOrigin-RevId: 518332541
 2023-03-21 11:34:39 -07:00
Jiuqiang TangandCopybara-Service 5a924669b7 Temporarily disabling checking whether the executor is not set in a subgraph node. This is a workaround to allow the MediaPipe InferenceCalculator to have its own executor. 
PiperOrigin-RevId: 518117759
 2023-03-20 17:10:55 -07:00
Jiuqiang TangandCopybara-Service f06e4224b8 Allow ModelResourcesCalculator to use file_pointer_meta. 
PiperOrigin-RevId: 517742722
 2023-03-19 01:33:52 -07:00
Jiuqiang TangandCopybara-Service 6634d22161 Add LabelMapProto.java source code to MediaPipe AAR. 
PiperOrigin-RevId: 517563190
 2023-03-17 19:49:53 -07:00
Jiuqiang TangandCopybara-Service 6785bcc47d Add java_package and java_outer_classname to label_map.proto. 
PiperOrigin-RevId: 517563000
 2023-03-17 19:45:45 -07:00
Jiuqiang TangandCopybara-Service 065f1f38aa Fix the vision tasks aar build rule to solve the "cannot find symbol" error: 
```
mediapipe/tasks/java/com/google/mediapipe/tasks/vision/imagesegmenter/ImageSegmenter.java:28: error: cannot find symbol
import com.google.mediapipe.tasks.TensorsToSegmentationCalculatorOptionsProto;
```

PiperOrigin-RevId: 517542284
 2023-03-17 17:02:22 -07:00
Jiuqiang TangandCopybara-Service 0805d61bfe Add the source code TensorsToSegmentationCalculatorOptionsProto.java into tasks core's maven package. 
PiperOrigin-RevId: 517516701
 2023-03-17 15:01:33 -07:00
Jiuqiang TangandCopybara-Service cd2cc971bb Registering FaceGeometry proto. 
PiperOrigin-RevId: 516663848
 2023-03-14 16:28:48 -07:00
Jiuqiang TangandCopybara-Service fef8b9cb58 Registering FaceGeometry proto. 
PiperOrigin-RevId: 516597971
 2023-03-14 12:21:02 -07:00
Jiuqiang TangandCopybara-Service 57f106e0a7 Wait until the metal backend finishes its work in the TensorsToImageCalculator. 
PiperOrigin-RevId: 516360846
 2023-03-13 16:56:46 -07:00
Jiuqiang TangandCopybara-Service 1d2041b992 Internal change 
PiperOrigin-RevId: 516220827
 2023-03-13 08:43:21 -07:00
Jiuqiang TangandCopybara-Service 3e8fd58400 Make createAudioRecord a class method not a static method. 
PiperOrigin-RevId: 515740313
 2023-03-10 14:34:32 -08:00
Jiuqiang TangandCopybara-Service 5bd6a7082a Add requiredInputBufferSize as an input argument of createAudioRecord. 
PiperOrigin-RevId: 515374407
 2023-03-09 10:30:49 -08:00
Jiuqiang TangandCopybara-Service 253a5b477e Implement face stylizer graph and its C++ API. 
PiperOrigin-RevId: 515139282
 2023-03-08 14:18:08 -08:00
Jiuqiang TangandCopybara-Service ddc535e705 Add DftTensorFormat To TensorsToAudioCalculatorOptions. 
PiperOrigin-RevId: 515077766
 2023-03-08 10:38:40 -08:00
Jiuqiang TangandCopybara-Service dbd6d72696 Add GetInputImageTensorSpecs into BaseVisionTaskApi for tasks api users to get input image tensor specifications. 
PiperOrigin-RevId: 514650593
 2023-03-07 00:44:07 -08:00
Jiuqiang TangandCopybara-Service 77fcaa9597 Allow TensorsToAudioCalculator to add and overlay adjacent windows. 
PiperOrigin-RevId: 514483756
 2023-03-06 12:08:57 -08:00
Jiuqiang TangandCopybara-Service 172b360478 Remove unused variable 'input_num'. 
PiperOrigin-RevId: 513009671
 2023-02-28 12:37:03 -08:00
Jiuqiang TangandCopybara-Service 646ab8505a Small fixes to TensorsToImageCalculator. 
PiperOrigin-RevId: 512967357
 2023-02-28 10:11:42 -08:00
Jiuqiang TangandCopybara-Service aa61abe386 Implement TensorsToImageCalculator. 
PiperOrigin-RevId: 512687103
 2023-02-27 11:46:07 -08:00
Jiuqiang TangandCopybara-Service 8a0830ce7b Add "java_package" and "java_outer_classname" to ImageTransformationCalculatorOptions. 
PiperOrigin-RevId: 510720513
 2023-02-18 16:58:56 -08:00
Jiuqiang TangandCopybara-Service 01c6a8b49b Add volume_gain_db option into AudioToTensorCalculator. 
PiperOrigin-RevId: 507748012
 2023-02-07 05:14:42 -08:00
Jiuqiang TangandCopybara-Service f4b0cf1cff Internal change 
PiperOrigin-RevId: 507540898
 2023-02-06 11:48:51 -08:00
Jiuqiang TangandCopybara-Service 8e097ea9c3 Internal changes 
PiperOrigin-RevId: 507016761
 2023-02-03 16:07:42 -08:00
Jiuqiang TangandCopybara-Service 2c4dece023 Internal change 
PiperOrigin-RevId: 505723714
 2023-01-30 10:00:22 -08:00
Jiuqiang TangandCopybara-Service 0566e0e7ca Fix the output stream tag of the end loop calculator in the example code. 
PiperOrigin-RevId: 504708273
 2023-01-25 17:52:55 -08:00
Jiuqiang TangandCopybara-Service 29484702ce Add process_timestamp_bounds into RectToRenderScaleCalculatorOptions. 
PiperOrigin-RevId: 502877541
 2023-01-18 08:02:47 -08:00
Jiuqiang TangandCopybara-Service 7a4b450c50 Resolve the error "call to 'abs' is ambiguous". 
PiperOrigin-RevId: 502630518
 2023-01-17 10:53:14 -08:00
Jiuqiang TangandCopybara-Service 7974171c3d Merge classificationResultList() and classificationResult() to be classificationResults(), and similar for embeddingResults(). 
PiperOrigin-RevId: 502601043
 2023-01-17 09:06:49 -08:00
Jiuqiang TangandCopybara-Service 8156da3418 ClassificationAggregationCalculator should fill in the timestamp_ms field of the classification results in the stream mode. 
Per user feedback, the consistency between the packet timestamp and the timestamp field of the classification result helps reducing the confusion.

PiperOrigin-RevId: 501657922
 2023-01-12 13:54:55 -08:00
Jiuqiang TangandCopybara-Service 5c74ed2ae5 EmbeddingAggregationCalculator should fill in the timestamp_ms field of the embedding results in the stream mode. 
Per user feedback, the consistency between the packet timestamp and the timestamp field of the embedding result helps reducing the confusion.

PiperOrigin-RevId: 501572379
 2023-01-12 08:30:07 -08:00
Jiuqiang TangandCopybara-Service 25abd122b3 Support AudioRecord in MediaPipe audio tasks in Java. 
PiperOrigin-RevId: 501019327
 2023-01-10 09:45:40 -08:00
Jiuqiang TangandCopybara-Service 6032604f94 Hide base task api classes for MediaPipe Tasks Python from API docs 
PiperOrigin-RevId: 501004802
 2023-01-10 08:43:51 -08:00
Jiuqiang TangandCopybara-Service c8b8d1fe6b Remove scripts for building MediaPipe Python 3.7 wheels. 
PiperOrigin-RevId: 496962729
 2022-12-21 11:12:27 -08:00
Jiuqiang TangandCopybara-Service 714a6e555b Enable creating mediapipe image c++ packet directly from an Android media image object when its format is RGBA_8888. 
PiperOrigin-RevId: 496923491
 2022-12-21 08:07:53 -08:00
Jiuqiang TangandCopybara-Service 151e447614 Internal changes 
PiperOrigin-RevId: 496793199
 2022-12-20 17:52:17 -08:00
Jiuqiang TangandCopybara-Service 9067804005 Fix the missing logging component issue of mediapipe tasks core. 
PiperOrigin-RevId: 496548340
 2022-12-19 19:41:11 -08:00
Jiuqiang TangandCopybara-Service 7ce4bb72d4 Replace numpy.float with the builtin float type as numpy removes its own float type in v1.24. 
PiperOrigin-RevId: 496412858
 2022-12-19 09:02:51 -08:00
Jiuqiang TangandCopybara-Service 6bf5648430 Fix the documentation of the constructor of Image and ImageFrame Python classes. 
PiperOrigin-RevId: 495739875
 2022-12-15 17:42:23 -08:00
Jiuqiang TangandCopybara-Service fd50b6aa2f Add a new python unit test to test creating mediapipe Image from cvmat. 
PiperOrigin-RevId: 495655719
 2022-12-15 11:54:51 -08:00
Jiuqiang TangandCopybara-Service 299aa03302 Internal change 
PiperOrigin-RevId: 495613573
 2022-12-15 09:24:31 -08:00
Jiuqiang TangandCopybara-Service 174f2869a3 Internal changes 
PiperOrigin-RevId: 495322170
 2022-12-14 08:33:45 -08:00
Jiuqiang TangandCopybara-Service 78597c5b37 Internal changes. 
PiperOrigin-RevId: 495038477
 2022-12-13 09:08:15 -08:00
Jiuqiang TangandCopybara-Service 453d67de92 Add MergeDetectionsToVectorCalculator. 
PiperOrigin-RevId: 494246359
 2022-12-09 13:12:57 -08:00
Jiuqiang TangandCopybara-Service 13f8fa5139 Retire the visibility group "//mediapipe/framework:mediapipe_internal" in the "mediapipe/calculators/tensor" dir. 
PiperOrigin-RevId: 493895834
 2022-12-08 08:03:47 -08:00
Jiuqiang TangandCopybara-Service ef1507ed5d Retire the visibility group "//mediapipe/framework:mediapipe_internal". 
PiperOrigin-RevId: 493713823
 2022-12-07 14:45:49 -08:00
Jiuqiang TangandCopybara-Service 955f090f9f Retire the visibility group "//mediapipe/framework:mediapipe_internal". 
PiperOrigin-RevId: 493687025
 2022-12-07 13:08:33 -08:00
Jiuqiang TangandCopybara-Service 3c0ddf16b4 Fix an incorrect model sanity check in the object detector graph. 
PiperOrigin-RevId: 493663592
 2022-12-07 11:38:54 -08:00
Jiuqiang TangandCopybara-Service 80c605459c Open up framework visibility. 
PiperOrigin-RevId: 493660013
 2022-12-07 11:26:16 -08:00
Jiuqiang TangandCopybara-Service 6deef1a5f1 Allow specifying tag_suffix in the templated CreateModelResources method. 
PiperOrigin-RevId: 493375701
 2022-12-06 12:10:06 -08:00
Jiuqiang TangandCopybara-Service c6e6f9e0b9 Fix aar breakage caused by missing "//mediapipe/tasks/cc/vision/image_segmenter/proto:segmenter_options_java_proto_lite". 
PiperOrigin-RevId: 493357585
 2022-12-06 11:08:01 -08:00
Jiuqiang TangandCopybara-Service fb0b96115f Open up mediapipe core calculators' visibility. 
PiperOrigin-RevId: 493314353
 2022-12-06 08:40:57 -08:00
Jiuqiang TangandCopybara-Service 1761cdcef4 Fix aar breakage caused by missing "//mediapipe/tasks/java/com/google/mediapipe/tasks/components/containers:normalized_landmark". 
PiperOrigin-RevId: 493204770
 2022-12-05 22:16:46 -08:00
Jiuqiang TangandCopybara-Service 1e76d47a71 Checks if a custom global resource provider is used as the first step of loading the model resources on all platforms. 
PiperOrigin-RevId: 493141519
 2022-12-05 16:20:20 -08:00
Jiuqiang TangandCopybara-Service ead41132a8 Load model file content from model file path with the help of GetResourceContents in browsers. 
This can handle the model files that are provided via a custom ResourceProviderFn.

PiperOrigin-RevId: 492308453
 2022-12-01 15:03:57 -08:00
Jiuqiang TangandCopybara-Service af990c3da1 Open up the visibility of "//mediapipe/java/com/google/mediapipe/framework/image:image". 
PiperOrigin-RevId: 492308109
 2022-12-01 15:00:25 -08:00
Jiuqiang TangandCopybara-Service 3ee37800e2 Depending on "inference_calculator_cpu" when the mediapipe tasks can only support cpu inference. 
PiperOrigin-RevId: 492205954
 2022-12-01 08:43:30 -08:00
Jiuqiang TangandCopybara-Service e7eee27c1c Remove the deleted library "mediapipe/tasks/java/com/google/mediapipe/tasks/components/processors:embedderoptions" from mediapipe_tasks_aar's android_library deps list. 
PiperOrigin-RevId: 492200061
 2022-12-01 08:17:12 -08:00
Jiuqiang TangandCopybara-Service 460aee7933 Make mediapipe_tasks_aar's android_library depend on "//third_party:androidx_annotation". 
PiperOrigin-RevId: 492092487
 2022-11-30 20:45:02 -08:00
Jiuqiang TangandCopybara-Service c8a413bb4e Open up mediapipe framework's visibility. 
PiperOrigin-RevId: 491672877
 2022-11-29 10:19:44 -08:00
Jiuqiang TangandCopybara-Service 1b594a0310 Return error status when any tflite input and output tensor doesn't have valid dimensionality information that is needed to allocate Gl/Metal buffer before calling ModifyGraphWithDelegate. 
PiperOrigin-RevId: 489539740
 2022-11-18 12:44:55 -08:00
Jiuqiang TangandCopybara-Service e046982a3c Internal change 
PiperOrigin-RevId: 489484898
 2022-11-18 08:47:09 -08:00
Jiuqiang TangandCopybara-Service a94564540b Bump up the dependency library pybind11's version to 2.10.1. 
PiperOrigin-RevId: 488718815
 2022-11-15 11:51:20 -08:00
Jiuqiang TangandCopybara-Service 87dff8142c Fix a typo. 
PiperOrigin-RevId: 488519113
 2022-11-14 18:13:50 -08:00
Jiuqiang TangandCopybara-Service f16e63694e Build embedding tasks into tasks AARs. 
PiperOrigin-RevId: 488509942
 2022-11-14 17:18:12 -08:00
Jiuqiang TangandCopybara-Service 794f64db55 Fix the wrong path of "text_embedder_graph_options_java_proto_lite". 
PiperOrigin-RevId: 488490050
 2022-11-14 15:51:05 -08:00
Jiuqiang TangandCopybara-Service cce1751dbf Expose tasks components API in PyPI packages. 
PiperOrigin-RevId: 488487666
 2022-11-14 15:41:11 -08:00
Jiuqiang TangandCopybara-Service e714e656fe Update python documentation. 
PiperOrigin-RevId: 488482142
 2022-11-14 15:18:47 -08:00
Jiuqiang TangandCopybara-Service b4fba6fe61 MediaPipe Tasks AudioEmbedder Java API 
PiperOrigin-RevId: 488456442
 2022-11-14 13:42:55 -08:00
Jiuqiang TangandCopybara-Service b40b2ade14 Fix typos. 
PiperOrigin-RevId: 488416345
 2022-11-14 11:07:59 -08:00
Jiuqiang TangandCopybara-Service 4b5c3521af Dividing the timestamp by 1000 when returning a "none" result object from GestureRecognizer and HandLandmarker APIs. 
PiperOrigin-RevId: 488409077
 2022-11-14 10:44:20 -08:00
Jiuqiang TangandCopybara-Service 6c0ca947de MediaPipe Tasks Audio embedder C++ API. 
PiperOrigin-RevId: 488273381
 2022-11-13 23:10:23 -08:00
Jiuqiang TangandCopybara-Service 8aa59faaa4 Internal change 
PiperOrigin-RevId: 488193046
 2022-11-13 09:51:48 -08:00
Jiuqiang TangandCopybara-Service bf6c8a0b63 Expose ImageEmbedder APIs in PyPI packages. 
PiperOrigin-RevId: 488033833
 2022-11-12 04:35:22 -08:00
Jiuqiang TangandCopybara-Service ce292c2a49 Fix a typo. 
PiperOrigin-RevId: 487872120
 2022-11-11 11:20:14 -08:00
Jiuqiang TangandCopybara-Service f329e38dc1 Map the "com_github_glog_glog" dependency of "com_google_sentencepiece" to mediapipe's "com_github_glog_glog_no_gflags". 
PiperOrigin-RevId: 487727239
 2022-11-10 22:12:42 -08:00
Jiuqiang TangandCopybara-Service 849134cfce Copy metatdata_schema.fbs into PyPI packages. 
PiperOrigin-RevId: 487685505
 2022-11-10 17:48:48 -08:00
Jiuqiang TangandCopybara-Service b3ac1c1387 Changes to create MediaPipe Tasks Audio AAR. 
PiperOrigin-RevId: 487661296
 2022-11-10 15:55:33 -08:00
Jiuqiang TangandCopybara-Service d6ba5e4bbe Map the "com_github_glog_glog" dependency of "com_google_audio_tools" to mediapipe's "com_github_glog_glog_no_gflags". 
PiperOrigin-RevId: 487651038
 2022-11-10 15:11:57 -08:00
Jiuqiang TangandCopybara-Service bb5782ee2f Correct the timestamp in the vision tasks result objects. 
PiperOrigin-RevId: 487597999
 2022-11-10 11:46:16 -08:00
Jiuqiang TangandCopybara-Service da4d455d0c Implement MediaPipe Tasks AudioClassifier Java API. 
PiperOrigin-RevId: 487570148
 2022-11-10 10:10:03 -08:00
Jiuqiang TangandCopybara-Service 2ce3a9719e Remove the problematic packet release calls in OutputHandler::run. 
OutputHandler::run is installed as a MultiStreamCallback into the TaskRunner and it's invoked in the Graph::CallbackToJava() jni method.

In CallbackToJava(), the packets are removed in RemovePacket() calls after the multi stream callback is invoked. The current logic lets the MultiStreamCallback release the packets first and leaves null pointers to RemovePacket() to remove, which may cause the app crash. The fix is to remove the packet release calls in the MultiStreamCallback and always leave the packet release work to RemovePacket().

PiperOrigin-RevId: 487558809
 2022-11-10 09:27:35 -08:00
Jiuqiang TangandCopybara-Service 6f66a7fde4 Rename GestureRecognitionResult to GestureRecognizerResult. 
PiperOrigin-RevId: 487306292
 2022-11-09 11:49:29 -08:00
Jiuqiang TangandCopybara-Service 4e568a1c3d Expose HandLandmarker API in PyPI packages. 
PiperOrigin-RevId: 487294501
 2022-11-09 11:06:33 -08:00